Update README.md
Browse files
README.md
CHANGED
@@ -12,6 +12,7 @@ This model [Hunyuan-1.8B-Instruct-dwq4-mlx](https://huggingface.co/Hunyuan-1.8B-
|
|
12 |
converted to MLX format from [tencent/Hunyuan-1.8B-Instruct](https://huggingface.co/tencent/Hunyuan-1.8B-Instruct)
|
13 |
using mlx-lm version **0.26.3**.
|
14 |
|
|
|
15 |
## Use with mlx
|
16 |
|
17 |
```bash
|
@@ -23,7 +24,7 @@ from mlx_lm import load, generate
|
|
23 |
|
24 |
model, tokenizer = load("Hunyuan-1.8B-Instruct-dwq4-mlx")
|
25 |
|
26 |
-
prompt = "
|
27 |
|
28 |
if tokenizer.chat_template is not None:
|
29 |
messages = [{"role": "user", "content": prompt}]
|
@@ -33,3 +34,27 @@ if tokenizer.chat_template is not None:
|
|
33 |
|
34 |
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
35 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
converted to MLX format from [tencent/Hunyuan-1.8B-Instruct](https://huggingface.co/tencent/Hunyuan-1.8B-Instruct)
|
13 |
using mlx-lm version **0.26.3**.
|
14 |
|
15 |
+
|
16 |
## Use with mlx
|
17 |
|
18 |
```bash
|
|
|
24 |
|
25 |
model, tokenizer = load("Hunyuan-1.8B-Instruct-dwq4-mlx")
|
26 |
|
27 |
+
prompt = "How many R are in Strawberry"
|
28 |
|
29 |
if tokenizer.chat_template is not None:
|
30 |
messages = [{"role": "user", "content": prompt}]
|
|
|
34 |
|
35 |
response = generate(model, tokenizer, prompt=prompt, verbose=True)
|
36 |
```
|
37 |
+
|
38 |
+
```bash
|
39 |
+
|
40 |
+
<think>
|
41 |
+
Okay, the user is asking how many "R" are in the word "Strawberry." Let me start by writing out the word: S-T-R-A-W-B-E-R-R-Y. Now I need to count the R's. Let's go through each letter:
|
42 |
+
|
43 |
+
1. S (no)
|
44 |
+
2. T (no)
|
45 |
+
3. R (yes, that's one)
|
46 |
+
4. A (no)
|
47 |
+
5. W (no)
|
48 |
+
6. B (no)
|
49 |
+
7. E (no)
|
50 |
+
8. R (second R)
|
51 |
+
9. R (third R)
|
52 |
+
10. Y (no)
|
53 |
+
|
54 |
+
So that's three R's. Let me double-check to make sure I didn't miss any. The word is "Strawberry," which is spelled S-T-R-A-W-B-E-R-R-Y. Yep, the R's are at positions 3, 8, and 9. So three R's in total.
|
55 |
+
</think>
|
56 |
+
<answer>
|
57 |
+
The word "Strawberry" contains **3 R's**.
|
58 |
+
</answer>
|
59 |
+
```
|
60 |
+
|