Hugging Face's logo

zenlm
/
zen-next-80b-instruct

Text Generation
Transformers
English
qwen2
zen
thinking-mode
zoo-gym
hanzo-ai
Eval Results
Model card Files
xet
Community
zen-next-80b-instruct
File size: 2,700 Bytes 
0922c70
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
 
---
license: apache-2.0
base_model: Qwen/Qwen2.5-72B-Instruct
tags:
- transformers
- zen
- text-generation
- thinking-mode
- zoo-gym
- hanzo-ai
language:
- en
pipeline_tag: text-generation
library_name: transformers
model-index:
- name: Zen-Next
  results:
  - task:
      type: text-generation
    dataset:
      name: MMLU
      type: MMLU
    metrics:
    - type: accuracy
      value: 0.7559999999999999
      name: MMLU
widget:
- text: "User: What is the capital of France?\n\nAssistant:"
---

# Zen-Next (80B)

Part of the [Zen AI Model Family](https://huggingface.co/zenlm)

## Model Description

**Parameters**: 80B  
**Base Model**: Qwen/Qwen2.5-72B-Instruct  
**Specialization**: Complex reasoning & extended context  
**Training**: Flagship training with constitutional AI  
**Context**: 32K-128K tokens  
**Thinking**: Up to 1,000,000 tokens  

## Files in This Repository

This repository contains ALL formats and quantizations:

### 🔷 SafeTensors (Original)
- `model.safetensors` - Full precision weights
- `config.json` - Model configuration
- `tokenizer.json` - Fast tokenizer

### 🟢 GGUF Quantized
- `zen-next-80b-instruct-Q4_K_M.gguf` - 4-bit (recommended)
- `zen-next-80b-instruct-Q5_K_M.gguf` - 5-bit (balanced)
- `zen-next-80b-instruct-Q8_0.gguf` - 8-bit (high quality)

### 🍎 MLX (Apple Silicon)
- `mlx-4bit/` - 4-bit quantized for M-series
- `mlx-8bit/` - 8-bit quantized for M-series

## Performance

| Benchmark | Score | Rank |
|-----------|-------|------|
| MMLU | 75.6% | Top 10% |
| GSM8K | 82.1% | Top 15% |
| HumanEval | 61.7% | Top 20% |

## Quick Start

### Transformers
```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("zenlm/zen-next-80b-instruct")
tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-next-80b-instruct")

# With thinking mode
messages = [{"role": "user", "content": "Your question here"}]
text = tokenizer.apply_chat_template(messages, enable_thinking=True)
```

### GGUF with llama.cpp
```bash
./main -m zen-next-80b-instruct-Q4_K_M.gguf -p "Your prompt" -n 512
```

### MLX for Apple Silicon
```python
from mlx_lm import load, generate
model, tokenizer = load("zenlm/zen-next-80b-instruct")
response = generate(model, tokenizer, "Your prompt", max_tokens=200)
```

## Unique Training Background

Flagship training with constitutional AI

This model was specifically optimized for complex reasoning & extended context with careful attention to:
- Inference efficiency
- Memory footprint
- Quality preservation
- Thinking capabilities

---

Part of the Zen Family • [Collection](https://huggingface.co/collections/zenlm/zen) • [GitHub](https://github.com/zenlm/zen)