Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

27,738

Full-text search

Active filters: 8-bit

FriendliAI/Mistral-7B-Instruct-v0.2-fp8

Text Generation • Updated Apr 18, 2024 • 37 • 12

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 31 • 1

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 170k • 74

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 10k • 29

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 212k • 78

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16, 2024 • 9.72k • 127

PrunaAI/KoboldAI-OPT-2.7B-Erebus-GPTQ-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 9 • 1

FriendliAI/c4ai-command-r-plus-fp8

Text Generation • Updated Apr 19, 2024 • 35 • 4

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 18.9k • 168

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 294k • 88

FriendliAI/Meta-Llama-3-70B-fp8

Text Generation • Updated Aug 1, 2024 • 34 • 5

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Jun 28, 2024 • 226k • 57

MaziyarPanahi/Llama-3-8B-Instruct-64k-GGUF

Text Generation • Updated Apr 25, 2024 • 202k • 13

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 18 • 9

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 254k • 93

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 2 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 10 • 2

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29, 2024 • 47 • 7

cortecs/Mistral-7B-Instruct-v0.3-GPTQ-8b

Text Generation • Updated Jun 18, 2024 • 19 • 1

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 54 • 15

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 191 • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 231 • 17

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 296 • 3

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 181k • 11

amirMohammadi/Dorna-Llama3-8B-Instruct-Quantized4Bit

Text Generation • Updated Jun 17, 2024 • 73 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 8 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 205k • 18

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3, 2024 • 948 • 26

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9, 2024 • 321 • 7

biomap-research/proteinglm-100b-int4

Updated Mar 17 • 263 • 8