Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
Mixtral-8x7B-Instruct-v0.1-GGUF

Transformers
GGUF
mixtral
conversational
Model card Files Files and versions Community
32
Mixtral-8x7B-Instruct-v0.1-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
TheBloke's picture
TheBloke
GGUF model commit (made with llama.cpp commit 8a7b2fa)
04c7b2b over 1 year ago
  • .gitattributes
    1.89 kB
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
  • mixtral-8x7b-instruct-v0.1.Q2_K.gguf
    15.6 GB
    LFS
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
  • mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf
    20.4 GB
    LFS
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
  • mixtral-8x7b-instruct-v0.1.Q4_0.gguf
    26.4 GB
    LFS
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
  • mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf
    26.4 GB
    LFS
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago
  • mixtral-8x7b-instruct-v0.1.Q5_0.gguf
    32.2 GB
    LFS
    GGUF model commit (made with llama.cpp commit 8a7b2fa) over 1 year ago