Mungert
/

Qwen2.5-1.5B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Qwen2.5-1.5B-Instruct-GGUF

Ctrl+K

Ctrl+K

2 contributors

History: 23 commits

Mungert's picture

Upload Qwen2.5-1.5B-Instruct-iq4_xs.gguf with huggingface_hub

24fb2fd verified 6 months ago

.gitattributes

2.99 kB

Upload Qwen2.5-1.5B-Instruct-iq4_xs.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf

1.55 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf

1.87 GB
xet

Upload Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q4_k.gguf

1.26 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q4_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q6_k.gguf

1.55 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q6_k.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-f16-q8_0.gguf

1.87 GB
xet

Upload Qwen2.5-1.5B-Instruct-f16-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-iq3_xs.gguf

732 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq3_xs.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-iq4_nl.gguf

936 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq4_nl.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-iq4_xs.gguf

896 MB
xet

Upload Qwen2.5-1.5B-Instruct-iq4_xs.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q2_k_l.gguf

733 MB
xet

Upload Qwen2.5-1.5B-Instruct-q2_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q3_k_l.gguf

881 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q3_k_m.gguf

824 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q3_k_s.gguf

761 MB
xet

Upload Qwen2.5-1.5B-Instruct-q3_k_s.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_0.gguf

991 MB
xet

Upload Qwen2.5-1.5B-Instruct-q4_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_k_l.gguf

1.04 GB
xet

Upload Qwen2.5-1.5B-Instruct-q4_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q4_k_s.gguf

940 MB
xet

Upload Qwen2.5-1.5B-Instruct-q4_k_s.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q5_k_m.gguf

1.13 GB
xet

Upload Qwen2.5-1.5B-Instruct-q5_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q5_k_s.gguf

1.1 GB
xet

Upload Qwen2.5-1.5B-Instruct-q5_k_s.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q6_k_l.gguf

1.33 GB
xet

Upload Qwen2.5-1.5B-Instruct-q6_k_l.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q6_k_m.gguf

1.27 GB
xet

Upload Qwen2.5-1.5B-Instruct-q6_k_m.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct-q8_0.gguf

1.65 GB
xet

Upload Qwen2.5-1.5B-Instruct-q8_0.gguf with huggingface_hub 6 months ago
Qwen2.5-1.5B-Instruct.imatrix

2.04 MB
xet

Upload Qwen2.5-1.5B-Instruct.imatrix with huggingface_hub 6 months ago
README.md

11.2 kB

Upload README.md with huggingface_hub 6 months ago