Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

30,121

Full-text search

Active filters: 4-bit

TheBloke/openinstruct-mistral-7B-AWQ

Text Generation • Updated Nov 26, 2023 • 3

TheBloke/openinstruct-mistral-7B-GPTQ

Text Generation • Updated Nov 26, 2023 • 2 • 3

Chat-Error/Testing_orca

Text Generation • Updated Nov 24, 2023 • 2 • 1

LoftQ/Mistral-7B-v0.1-4bit-64rank

Text Generation • Updated Apr 18, 2024 • 69 • 2

csdc-atl/buffer-baichuan2-13B-rag-4bits

Text Generation • Updated Dec 5, 2023 • 6

flozi00/Mistral-7B-german-assistant-v5-4bit-autogptq

Text Generation • Updated Nov 22, 2023 • 2 • 1

TheBloke/MythoMist-7B-AWQ

Text Generation • Updated Nov 22, 2023 • 6 • 4

TheBloke/MythoMist-7B-GPTQ

Text Generation • Updated Nov 22, 2023 • 21 • 4

TheBloke/Tess-M-v1.1-GPTQ

Text Generation • Updated Nov 22, 2023 • 3 • 1

TheBloke/Tess-M-v1.1-AWQ

Text Generation • Updated Nov 22, 2023 • 2 • 1

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 23 • 60

01-ai/Yi-6B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 173 • 22

sharkMeow/results

Updated Nov 25, 2023

TheBloke/OrionStar-Yi-34B-Chat-Llama-GPTQ

Text Generation • Updated Nov 22, 2023 • 12 • 4

TheBloke/OrionStar-Yi-34B-Chat-Llama-AWQ

Text Generation • Updated Nov 22, 2023 • 5 • 3

EnzoVeltri/tableLlama-4bit

Text Generation • Updated Nov 22, 2023 • 2

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy

Text Generation • Updated Nov 23, 2023 • 1

TheBloke/rocket-3B-GPTQ

Text Generation • Updated Nov 22, 2023 • 65

florentgbelidji/leoLM-13b-sft-lora-oa

Text Generation • Updated Nov 23, 2023 • 2 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-low-rank

Text Generation • Updated Nov 22, 2023 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-tiny-rank

Text Generation • Updated Nov 24, 2023

TheBloke/Tess-XS-Creative-v1.0-GPTQ

Text Generation • Updated Nov 22, 2023 • 8 • 1

TheBloke/Tess-XS-Creative-v1.0-AWQ

Text Generation • Updated Nov 22, 2023 • 2 • 1

TheBloke/Tess-XS-v1.1-GPTQ

Text Generation • Updated Nov 22, 2023 • 3 • 1

TheBloke/Tess-XS-v1.1-AWQ

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/Chupacabra-7B-v2-AWQ

Text Generation • Updated Nov 23, 2023 • 2 • 1

TheBloke/Chupacabra-7B-v2-GPTQ

Text Generation • Updated Nov 23, 2023 • 3 • 1

TheBloke/Ferret_7B-GPTQ

Text Generation • Updated Nov 23, 2023 • 3 • 2

TheBloke/Ferret_7B-AWQ

Text Generation • Updated Nov 23, 2023 • 2 • 1

TheBloke/speechless-mistral-7B-dare-0.85-GPTQ

Text Generation • Updated Nov 23, 2023 • 2 • 2