Hugging Face's logo

yasu-oh
/
Magistral-Small-2506-GGUF

Text Generation
GGUF
English
Japanese
imatrix
conversational
Model card Files
xet
Community

Magistral-Small-2506-GGUF

base_model: mistralai/Magistral-Small-2506

imatrix: TFMC/imatrix-dataset-for-japanese-llm

Downloads last month
56
GGUF
Model size
23.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

5-bit

Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yasu-oh/Magistral-Small-2506-GGUF

Base model

mistralai/Mistral-Small-3.1-24B-Base-2503
Finetuned
mistralai/Mistral-Small-3.1-24B-Instruct-2503
Finetuned
mistralai/Magistral-Small-2506
Quantized
(25)
this model

Dataset used to train yasu-oh/Magistral-Small-2506-GGUF