Hugging Face's logo

unsloth
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

GGUF
vllm
mistral3
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
38abcd1
·
verified ·
1 Parent(s): b7e8bc2

Add files using upload-large-folder tool

Browse files
Files changed (6) hide show
  1. Mistral-Small-3.1-24B-Instruct-2503-Q2_K.gguf +2 -2
  2. Mistral-Small-3.1-24B-Instruct-2503-Q3_K_M.gguf +2 -2
  3. Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf +2 -2
  4. Mistral-Small-3.1-24B-Instruct-2503-Q5_K_M.gguf +2 -2
  5. Mistral-Small-3.1-24B-Instruct-2503-Q6_K.gguf +2 -2
  6. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_XXS.gguf +2 -2
Mistral-Small-3.1-24B-Instruct-2503-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a9c4268498c90bf66fdbaed002eca01b0449fd207b13a3bb3e8b9df959337c7
3
- size 8890323872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fd23abc9f799e948c758450bb5dbf41eba0ab0f10fdd952a433ea1f76e357f5
3
+ size 8890326592
Mistral-Small-3.1-24B-Instruct-2503-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:088b06a56c50c91e65cfb9323e22d8b0d09d71c02fdb8cd19c249151c2cf355b
3
- size 11474080672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aa4bb69f19451c03261d7cef3121f3f469a87d2b9132e04e77827bf87334316
3
+ size 11474083392
Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6a73d5446f4a2e9a00d1d1555581576e793b66878effbfeaef6f7292793b2c9
3
- size 14333907872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf0968f01e2c45db6c2d7feb419b85b235326b909d3221e2de1b1fb5eb00ad56
3
+ size 14333910592
Mistral-Small-3.1-24B-Instruct-2503-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:206ccefa0f8f5702b06d512577b60f7d088d55472047bc4b5e54a19e7f642921
3
- size 16763982752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e19e1a65c2bb2a3896e5e5c249e4e615f536be1f23a9131aad9ce60043fcfe1
3
+ size 16763985472
Mistral-Small-3.1-24B-Instruct-2503-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7cede6169b9c5eca19cb64ab7afd0fdafb96ab79f417d256010b11ef2d5c463c
3
- size 19345937312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86b9b16b2bdc3ca00d97fa7c1e460de6a25cf2dcfee46fd74311e9fb42190283
3
+ size 19345940032
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aae749b0b1c372cfaf5321636645cc47097668f51283c47e3bb25afa5fb82645
3
- size 6840030112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d350d382feb19ad70e1b5e71521a6b724b26792556d4020085c8e81f4a8c177
3
+ size 6750903872