Mungert
/

granite-3.1-3b-a800m-instruct-GGUF

Text Generation

Model card Files Files and versions

granite-3.1-3b-a800m-instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 32 commits

Mungert's picture

Upload granite-3.1-3b-a800m-instruct-iq4_nl.gguf with huggingface_hub

c075681 verified 2 months ago

.gitattributes

3.93 kB

Upload granite-3.1-3b-a800m-instruct-iq4_nl.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-bf16_q6_k.gguf

2.92 GB
xet

Upload granite-3.1-3b-a800m-instruct-bf16_q6_k.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-bf16_q8_0.gguf

3.68 GB
xet

Upload granite-3.1-3b-a800m-instruct-bf16_q8_0.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-f16.gguf

6.6 GB
xet

Upload granite-3.1-3b-a800m-instruct-f16.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-f16_q6_k.gguf

2.92 GB
xet

Upload granite-3.1-3b-a800m-instruct-f16_q6_k.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-f16_q8_0.gguf

3.68 GB
xet

Upload granite-3.1-3b-a800m-instruct-f16_q8_0.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq3_m.gguf

1.45 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq3_m.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq3_s.gguf

1.45 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq3_s.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq3_xs.gguf

1.37 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq3_xs.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq3_xxs.gguf

1.33 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq3_xxs.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq4_nl.gguf

1.88 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq4_nl.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-iq4_xs.gguf

1.78 GB
xet

Upload granite-3.1-3b-a800m-instruct-iq4_xs.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q2_k_l.gguf

1.27 GB
xet

Upload granite-3.1-3b-a800m-instruct-q2_k_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q2_k_m.gguf

1.25 GB
xet

Upload granite-3.1-3b-a800m-instruct-q2_k_m.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q2_k_s.gguf

1.17 GB
xet

Upload granite-3.1-3b-a800m-instruct-q2_k_s.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q3_k_l.gguf

1.66 GB
xet

Upload granite-3.1-3b-a800m-instruct-q3_k_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q3_k_m.gguf

1.64 GB
xet

Upload granite-3.1-3b-a800m-instruct-q3_k_m.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q3_k_s.gguf

1.53 GB
xet

Upload granite-3.1-3b-a800m-instruct-q3_k_s.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q4_0.gguf

1.86 GB
xet

Upload granite-3.1-3b-a800m-instruct-q4_0.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q4_0_l.gguf

1.9 GB
xet

Upload granite-3.1-3b-a800m-instruct-q4_0_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q4_1.gguf

2.07 GB
xet

Upload granite-3.1-3b-a800m-instruct-q4_1.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q4_1_l.gguf

2.1 GB
xet

Upload granite-3.1-3b-a800m-instruct-q4_1_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_0.gguf

2.28 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_0.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_0_l.gguf

2.3 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_0_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_1.gguf

2.48 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_1.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_1_l.gguf

2.51 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_1_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_k_l.gguf

2.44 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_k_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_k_m.gguf

2.42 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_k_m.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q5_k_s.gguf

2.39 GB
xet

Upload granite-3.1-3b-a800m-instruct-q5_k_s.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q6_k_l.gguf

2.73 GB
xet

Upload granite-3.1-3b-a800m-instruct-q6_k_l.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q6_k_m.gguf

2.71 GB
xet

Upload granite-3.1-3b-a800m-instruct-q6_k_m.gguf with huggingface_hub 2 months ago
granite-3.1-3b-a800m-instruct-q8_0.gguf

3.51 GB
xet

Upload granite-3.1-3b-a800m-instruct-q8_0.gguf with huggingface_hub 2 months ago