Quantized Llama models in 2,4, and 8 bit versions
Divyanshu Kumar
divyanshusingh
AI & ML interests
NLP, CV, Federated Learning
Recent Activity
new activity
about 4 hours ago
meta-llama/Llama-Guard-4-12B:The model is not working with vLLM or transformers library as well
updated
a model
4 months ago
mili-ai/gliner_large_v2.1-onnx
updated
a Space
7 months ago
enkryptai/README
Organizations
Collections
2
models
12

divyanshusingh/Mistral-7B-Instruct-v0.2-GGUF
Updated
•
3

divyanshusingh/Mistral-7B-Instruct-v0.3-GGUF
Updated
•
6

divyanshusingh/Mistral-Nemo-Instruct-2407-GGUF
Updated
•
14

divyanshusingh/Mistral-7B-Instruct-v0.1-GGUF
Updated
•
6

divyanshusingh/Llama-2-7b-chat-GGUF
Updated
•
6

divyanshusingh/CodeLlama-7b-GGUF
Updated
•
5

divyanshusingh/Llama-3-8b-Instruct-GGUF
Updated
•
4

divyanshusingh/Llama-3.1-8b-Instruct-GGUF
Updated
•
12

divyanshusingh/lora_ft_indicbart
Updated

divyanshusingh/my_awesome_model
Updated
datasets
0
None public yet