|
|
--- |
|
|
library_name: transformers |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- mistral |
|
|
inference: false |
|
|
base_model: alpindale/Mistral-7B-v0.2-hf |
|
|
--- |
|
|
|
|
|
# Mistral-7B-v0.2-hf-GGUF |
|
|
- Quantized version of [Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf) |
|
|
- The model is created by [mistralai](https://huggingface.co/mistralai) and weights provided by [alpindale](https://huggingface.co/alpindale) |
|
|
- Created using llama.cpp |
|
|
|
|
|
## Available Quants |
|
|
|
|
|
- Q2_K |
|
|
- Q3_K_L |
|
|
- Q3_K_M |
|
|
- Q3_K_S |
|
|
- Q4_0 |
|
|
- Q4_K_M |
|
|
- Q4_K_S |
|
|
- Q5_0 |
|
|
- Q5_K_M |
|
|
- Q5_K_S |
|
|
- Q6_K |
|
|
- Q8_0 |
|
|
|
