nightmedia commited on
Commit
bc9a458
·
verified ·
1 Parent(s): 4120a74

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -1
README.md CHANGED
@@ -12,6 +12,7 @@ This model [Hunyuan-1.8B-Instruct-dwq4-mlx](https://huggingface.co/Hunyuan-1.8B-
12
  converted to MLX format from [tencent/Hunyuan-1.8B-Instruct](https://huggingface.co/tencent/Hunyuan-1.8B-Instruct)
13
  using mlx-lm version **0.26.3**.
14
 
 
15
  ## Use with mlx
16
 
17
  ```bash
@@ -23,7 +24,7 @@ from mlx_lm import load, generate
23
 
24
  model, tokenizer = load("Hunyuan-1.8B-Instruct-dwq4-mlx")
25
 
26
- prompt = "hello"
27
 
28
  if tokenizer.chat_template is not None:
29
  messages = [{"role": "user", "content": prompt}]
@@ -33,3 +34,27 @@ if tokenizer.chat_template is not None:
33
 
34
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
35
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  converted to MLX format from [tencent/Hunyuan-1.8B-Instruct](https://huggingface.co/tencent/Hunyuan-1.8B-Instruct)
13
  using mlx-lm version **0.26.3**.
14
 
15
+
16
  ## Use with mlx
17
 
18
  ```bash
 
24
 
25
  model, tokenizer = load("Hunyuan-1.8B-Instruct-dwq4-mlx")
26
 
27
+ prompt = "How many R are in Strawberry"
28
 
29
  if tokenizer.chat_template is not None:
30
  messages = [{"role": "user", "content": prompt}]
 
34
 
35
  response = generate(model, tokenizer, prompt=prompt, verbose=True)
36
  ```
37
+
38
+ ```bash
39
+
40
+ <think>
41
+ Okay, the user is asking how many "R" are in the word "Strawberry." Let me start by writing out the word: S-T-R-A-W-B-E-R-R-Y. Now I need to count the R's. Let's go through each letter:
42
+
43
+ 1. S (no)
44
+ 2. T (no)
45
+ 3. R (yes, that's one)
46
+ 4. A (no)
47
+ 5. W (no)
48
+ 6. B (no)
49
+ 7. E (no)
50
+ 8. R (second R)
51
+ 9. R (third R)
52
+ 10. Y (no)
53
+
54
+ So that's three R's. Let me double-check to make sure I didn't miss any. The word is "Strawberry," which is spelled S-T-R-A-W-B-E-R-R-Y. Yep, the R's are at positions 3, 8, and 9. So three R's in total.
55
+ </think>
56
+ <answer>
57
+ The word "Strawberry" contains **3 R's**.
58
+ </answer>
59
+ ```
60
+