Text Generation
GGUF
all use cases
creative
creative writing
all genres
tool calls
tool use
qwen3_moe
problem solving
deep thinking
reasoning
deep reasoning
story
writing
fiction
roleplaying
bfloat16
role play
sillytavern
backyard
Lmstudio
context 128k
Mixture of Experts
mixture of experts
8 experts activated
128 experts
NEO Imatrix
Max Imatrix
qwen3
imatrix
conversational
Update README.md
Browse files
README.md
CHANGED
|
@@ -101,8 +101,6 @@ IQ2s will be a lot stronger than the IQ1_Ms.
|
|
| 101 |
IQ3s and higher quants will show a very large change in performance, with IQ4_XS/IQ4_NL being the peak for NEO Imatrix effect
|
| 102 |
and specific quality at this quant level.
|
| 103 |
|
| 104 |
-
NOTE: IQ3s will outperform "Q3s" quants, likewise for IQ2s vs Q2s quants.
|
| 105 |
-
|
| 106 |
Q4s will be high performance.
|
| 107 |
|
| 108 |
Q5s will be very high performance.
|
|
@@ -111,6 +109,12 @@ Q6 will be peak performance, but with minimal NEO imatrix effect(s).
|
|
| 111 |
|
| 112 |
Q8s (specialized) will be well... really, really great.
|
| 113 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 114 |
SPECIALIZED QUANTS:
|
| 115 |
|
| 116 |
Some quants will have multiple versions:
|
|
|
|
| 101 |
IQ3s and higher quants will show a very large change in performance, with IQ4_XS/IQ4_NL being the peak for NEO Imatrix effect
|
| 102 |
and specific quality at this quant level.
|
| 103 |
|
|
|
|
|
|
|
| 104 |
Q4s will be high performance.
|
| 105 |
|
| 106 |
Q5s will be very high performance.
|
|
|
|
| 109 |
|
| 110 |
Q8s (specialized) will be well... really, really great.
|
| 111 |
|
| 112 |
+
NOTES:
|
| 113 |
+
- IQ3s will outperform Q3s quants, likewise for IQ2s vs Q2s quants.
|
| 114 |
+
- IQ4_XS / IQ4_NL will perform at or outperform Q4s.
|
| 115 |
+
- IQ3_S / IQ3_M are very strong and can be used for most tasks.
|
| 116 |
+
- All Imatrix versions of quants will outperform their non-imatrix counterparts.
|
| 117 |
+
|
| 118 |
SPECIALIZED QUANTS:
|
| 119 |
|
| 120 |
Some quants will have multiple versions:
|