Hugging Face's logo

second-state
/
Nous-Hermes-2-Mixtral-8x7B-SFT-GGUF

Text Generation
Transformers
GGUF
English
mixtral
Mixtral
instruct
finetune
chatml
DPO
RLHF
gpt4
synthetic data
distillation
conversational
Model card Files Community
Xin Liu commited on
Commit
64017db
·
1 Parent(s): 44f37e2

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. Nous-Hermes-2-Mixtral-8x7B-SFT-Q2_K.gguf +3 -0
  3. Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_L.gguf +3 -0
  4. Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_M.gguf +3 -0
  5. Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_S.gguf +3 -0
  6. Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_0.gguf +3 -0
  7. Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_K_M.gguf +3 -0
  8. Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_K_S.gguf +3 -0
  9. Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_0.gguf +3 -0
  10. Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_M.gguf +3 -0
  11. Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_S.gguf +3 -0
  12. Nous-Hermes-2-Mixtral-8x7B-SFT-Q6_K.gguf +3 -0
  13. Nous-Hermes-2-Mixtral-8x7B-SFT-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Nous-Hermes-2-Mixtral-8x7B-SFT-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ee6b8b30b3984a3d52fc72f64bc41fbe14202e0865024873a19168bc0064b8f
3
+ size 17309182848
Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3b846ba0532684703af3c147bc8901687e92572a20b479327b49589d3c29dc5
3
+ size 24167599808
Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:598decf73bdfa4f5b77e50f2768ff7569565406093b86c26f10cde600b4e431d
3
+ size 22544404160
Nous-Hermes-2-Mixtral-8x7B-SFT-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c82592ed76cf949685896c061c89857074894dbcce9d3e8963bfaea898a785f
3
+ size 20430474944
Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2cfda8dbf8826ec44c1d1dcf6e0e40eb6645c33ac3acadec1e47d95e70f703f7
3
+ size 26441544448
Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5244fcc19e76e3e86d142451fff5602be6d4fb185ac5964e6d4279f9b8314c59
3
+ size 28446421760
Nous-Hermes-2-Mixtral-8x7B-SFT-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b724a2227e6631badfaf67fc18410750e0596d92c4c491f6392e309208671199
3
+ size 26743534336
Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83ae92a179b31fbe5dc123786f5e5ce7e7913c2e2888c20478a46eef71831952
3
+ size 32229291776
Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2599f102be866a80a86b5f03f75500704f6cd7de2dce51d27dd07293eb716770
3
+ size 33227536128
Nous-Hermes-2-Mixtral-8x7B-SFT-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:345e1b7046fe1fb4781752c2b9c8acf6dd504fee98e80d627c22738e616eb8d8
3
+ size 32229291776
Nous-Hermes-2-Mixtral-8x7B-SFT-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f91ae930ec6950f29f1773755332713f0340e4d8557aa6de51e0dccdeb28f86
3
+ size 38378773312
Nous-Hermes-2-Mixtral-8x7B-SFT-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea9ba731a8a38cc879d7ff537013f6d1db85f28469e0895391e3697c4552b020
3
+ size 49624279744