Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
19 minutes ago
cyberagent/Mistral-Nemo-Japanese-Instruct-2408
liked
a model
36 minutes ago
zai-org/GLM-4-32B-Base-0414
liked
a model
37 minutes ago
arcee-ai/GLM-4-32B-Base-32K
Organizations
models
221
nbeerbower/Eloisa-Qwen3-8B
8B
•
Updated
•
6
•
1
nbeerbower/Wenyan-Qwen3-8B
8B
•
Updated
•
6
•
1
nbeerbower/NikuXL-v0.1
Text-to-Image
•
Updated
•
3
nbeerbower/NikuX1-Test
Text-to-Image
•
Updated
•
3
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
33B
•
Updated
•
10
•
2
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
2
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
2
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
12B
•
Updated
•
29
•
4
nbeerbower/Vitus-Qwen3-14B
15B
•
Updated
•
18
•
4
nbeerbower/Vitus-mistral-nemo-12B
12B
•
Updated
•
10
datasets
21
nbeerbower/WenyanMix-DPO
Viewer
•
Updated
•
30.2k
•
65
nbeerbower/NikuX-DPO-captioned
Viewer
•
Updated
•
792
•
21
nbeerbower/NikuX-DPO-filtered
Viewer
•
Updated
•
792
•
16
nbeerbower/NikuX-DPO-concat
Viewer
•
Updated
•
883
•
11
nbeerbower/NikuX3-DPO-Filtered
Viewer
•
Updated
•
581
•
8
nbeerbower/NikuX3-DPO
Viewer
•
Updated
•
651
•
4
nbeerbower/NikuX2-DPO-Filtered
Viewer
•
Updated
•
282
•
7
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
47
•
1
nbeerbower/human-writing-dpo
Updated
•
79
•
6
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
7