
AmpereComputing/afm-4.5b-gguf
5B
•
Updated
•
33
Ampere's quantization formats (Q4_K_4 / Q8R16) require Ampere optimized llama.cpp available here: https://hub.docker.com/r/amperecomputingai/llama.cpp