Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
<h3> Experimental running Quants of "Dark Sapling V2 7B Ultra Quality" (32k context) in Imatrix Plus 2 and Imatrix X protocols. </h3>
|
5 |
+
|
6 |
+
Imatrix Plus 2 is an advanced Imatrix quanting method using multiple datasets.
|
7 |
+
|
8 |
+
Imatrix X takes Imatrix Plus 2 a step further and introduces a "pass-through merge" method between Imatrix Plus 2 and regular Quants.
|
9 |
+
|
10 |
+
This leverages the full power of both Imatrix Plus 2 and regular quant (which is based on Ultra Quality 32 bit precision).
|
11 |
+
|
12 |
+
Imatrix Plus 2 and Imatrix X are the next steps in Ultra Quality experience.
|
13 |
+
|
14 |
+
The quants hosted here are various versions of "Imatrix X" (with Imatrix Plus 2), with the exception of
|
15 |
+
"DarkSapling-V2-Ultra-Quality-7B-Q4_k_m-imat1.gguf" which is stand alone Imatrix Plus 2.
|
16 |
+
|
17 |
+
All quants operate, however there is more work in progress and these quants are subject to revision without notice.
|
18 |
+
|
19 |
+
For testing purposes (if you download more than one) set "TEMP:0" and test your prompt(s).
|
20 |
+
|
21 |
+
You should use prompts with "no right answer" to fully evalute the quant (and vs other quants here).
|
22 |
+
|
23 |
+
Not all of these quants are suitable for all purposes and protocol(s) are still under developement.
|
24 |
+
|
25 |
+
Although these are all "Q4_K_M Imatrix 2" quants they differ greatly due to Imatrix X protocols.
|
26 |
+
|
27 |
+
Caution: Can generate NSFW content.
|
28 |
+
|
29 |
+
For more information on Dark Sapling V2 Ultra Quality please see:
|
30 |
+
|
31 |
+
[ https://huggingface.co/DavidAU/DarkSapling-V2-Ultra-Quality-7B-GGUF ]
|