Hugging Face's logo

unsloth
/
Mistral-Small-3.1-24B-Instruct-2503-GGUF

GGUF
vllm
mistral3
conversational
Model card Files
xet
Community
5
danielhanchen commited on
Commit
b7e8bc2
·
verified ·
1 Parent(s): 1e41020

Add files using upload-large-folder tool

Browse files
Files changed (9) hide show
  1. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_M.gguf +2 -2
  2. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_S.gguf +2 -2
  3. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf +2 -2
  4. Mistral-Small-3.1-24B-Instruct-2503-UD-IQ3_XXS.gguf +2 -2
  5. Mistral-Small-3.1-24B-Instruct-2503-UD-Q2_K_XL.gguf +2 -2
  6. Mistral-Small-3.1-24B-Instruct-2503-UD-Q3_K_XL.gguf +2 -2
  7. Mistral-Small-3.1-24B-Instruct-2503-UD-Q4_K_XL.gguf +2 -2
  8. mmproj-F16.gguf +2 -2
  9. mmproj-F32.gguf +2 -2
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf8d159b4be8cdb44b740271221d6abec73713e17faf4af1952a4aa7d1ef5e99
3
- size 6017307552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b75cf1a91d0274c5866c06317b42a8b8df5b7ba6ff8ec76285c2231014fc447
3
+ size 6017310272
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a8be4ea27f5fdc0a5f177052d5556305609e47fb6c5c414c0869f2aef5186ff8
3
- size 5558555552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:555da76a53d17fd7f9ba52f004fe17577a36f23ebd1d386c4f84e85f53e1c270
3
+ size 5558558272
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50e33b2c790619953e95265956b8bad142b26c24983b0b6c0a122a7d60709a37
3
- size 8243319712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1a35973fb6d0c38eb02515108e585a8b8fe3ca0efa192d2885f9f0fc203dd44
3
+ size 8243322432
Mistral-Small-3.1-24B-Instruct-2503-UD-IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef96f8563ca8bedcbc3124a0c054b8c0d00930bf907f96481b9c41090ee7ceae
3
- size 9409205152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd802cfd1338a8e31bf887ae5db45742a5ff20c3e210b056430c3069b84a7354
3
+ size 9409207872
Mistral-Small-3.1-24B-Instruct-2503-UD-Q2_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94e21e6f01cb0bc4b335132540a3a032abd8714f7072d184cacae5ee2904f1ac
3
- size 9292141472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7f0b8818d3d34bd2e5d08e58a3b062c0b899f4402408071de87eb321d76c339
3
+ size 9292144192
Mistral-Small-3.1-24B-Instruct-2503-UD-Q3_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0253260dc482d1de853fe2c52da646561c6995ad875901bf8513422b2ba78457
3
- size 11850871712
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f5056d8d2ba73ed1d646430aa5ab5669ce6c294dd65e1071e2a398eabcd18b5c
3
+ size 11850874432
Mistral-Small-3.1-24B-Instruct-2503-UD-Q4_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:68ee6fa6e5f744bd3031d2523e05d7075077338de7a62f8767a0bf166f72c866
3
- size 14505612192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4e87ad817484ea3c71b78fcbabe9c8f46d78f0c0d8bf107883e180da66feeb0
3
+ size 14548868672
mmproj-F16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac0218c6262ac1524c46c2053a68455282b5a3c6529343df49df351c9633d6e5
3
- size 878053568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:724d8fcdafcd29f36114ac289ac88f7900e6fae4fc31e86db298a42a91a21954
3
+ size 878053472
mmproj-F32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69105e331585746cce2b35abd3e17e1ef064cd5af341138328fe24b73adc2574
3
- size 1755867328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:217ef4a1677b095fd9d5c8a03308ede4006845c0e90cfb83684d7a520c027ccb
3
+ size 1755867232