Mungert
/

Qwen2.5-1.5B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Qwen2.5-1.5B-Instruct-GGUF

Ctrl+K

Ctrl+K

2 contributors

History: 40 commits

Mungert's picture

Upload Qwen2.5-1.5B-Instruct-q4_0.gguf with huggingface_hub

285dace verified 5 months ago

.gitattributes

3.62 kB

Upload Qwen2.5-1.5B-Instruct-f16.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-bf16-q4_k.gguf

1.26 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16-q4_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf

1.55 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf

1.87 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-bf16.gguf

3.09 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q4_k.gguf

1.26 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q4_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q6_k.gguf

1.55 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q6_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q8_0.gguf

1.87 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16.gguf

3.09 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-iq3_m.gguf

746 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq3_m.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-iq3_s.gguf

731 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq3_s.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-iq3_xs.gguf

701 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq3_xs.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-iq3_xxs.gguf

669 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq3_xxs.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-iq4_nl.gguf

936 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq4_nl.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-iq4_xs.gguf

896 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq4_xs.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q2_k_l.gguf

733 MB
xet

Upload Qwen2.5-1.5B-Instruct-q2_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q3_k_l.gguf

881 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q3_k_m.gguf

793 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_m.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-q3_k_s.gguf

730 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_s.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-q4_0.gguf

875 MB
xet

Upload Qwen2.5-1.5B-Instruct-q4_0.gguf with huggingface_hub 5 months ago
Qwen2.5-1.5B-Instruct-q4_1.gguf

1.07 GB
xet

Upload Qwen2.5-1.5B-Instruct-q4_1.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_k_l.gguf

1.04 GB
xet

Upload Qwen2.5-1.5B-Instruct-q4_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_k_m.gguf

986 MB
xet

Upload Qwen2.5-1.5B-Instruct-q4_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_k_s.gguf

940 MB
xet

Upload Qwen2.5-1.5B-Instruct-q4_k_s.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q5_k_l.gguf

1.18 GB
xet

Upload Qwen2.5-1.5B-Instruct-q5_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q5_k_m.gguf

1.13 GB
xet

Upload Qwen2.5-1.5B-Instruct-q5_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q5_k_s.gguf

1.1 GB
xet

Upload Qwen2.5-1.5B-Instruct-q5_k_s.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q6_k_l.gguf

1.33 GB
xet

Upload Qwen2.5-1.5B-Instruct-q6_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q6_k_m.gguf

1.27 GB
xet

Upload Qwen2.5-1.5B-Instruct-q6_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q8_0.gguf

1.65 GB
xet

Upload Qwen2.5-1.5B-Instruct-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct.imatrix

2.04 MB
xet

Upload Qwen2.5-1.5B-Instruct.imatrix with huggingface_hub 6 months ago
README.md

4.92 kB

Upload README.md with huggingface_hub 5 months ago