Commit
·
78fb48b
1
Parent(s):
f748564
Initial
Browse files
README.md
CHANGED
@@ -129,20 +129,13 @@ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
129 |
|
130 |
#### Model
|
131 |
|
132 |
-
|
133 |
-
|
134 |
-
|
|
135 |
-
|
136 |
-
|
|
137 |
-
|
|
138 |
-
|
139 |
-
##### BitsAndBytes
|
140 |
-
|
141 |
-
| Parameter | Value |
|
142 |
-
|---------------------------|--------|
|
143 |
-
| load_in_4bit | `true` |
|
144 |
-
| bnb_4bit_quant_type | `nf4` |
|
145 |
-
| bnb_4bit_use_double_quant | `true` |
|
146 |
|
147 |
### Dataset
|
148 |
|
|
|
129 |
|
130 |
#### Model
|
131 |
|
132 |
+
| Parameter | Value |
|
133 |
+
|---------------------------|------------------------------------|
|
134 |
+
| Name | `Qwen/Qwen2.5-Coder-1.5B-Instruct` |
|
135 |
+
| Attention Implementation | `flash_attention_2` |
|
136 |
+
| load_in_4bit | `true` |
|
137 |
+
| bnb_4bit_quant_type | `nf4` |
|
138 |
+
| bnb_4bit_use_double_quant | `true` |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
139 |
|
140 |
### Dataset
|
141 |
|