Upload IQ4_KSS and perplexity graphs
Browse files- README.md +2 -2
- images/perplexity.png +3 -0
README.md
CHANGED
|
@@ -34,7 +34,7 @@ Perplexity computed against *wiki.test.raw*. These first two are just test quant
|
|
| 34 |
* `bf16` 437.989 GiB (16.003 BPW)
|
| 35 |
- Final estimate: PPL = 4.1898 +/- 0.02367
|
| 36 |
* `Q8_0` 232.769 GiB (8.505 BPW)
|
| 37 |
-
- Final estimate: PPL =
|
| 38 |
|
| 39 |
## `IQ5_K` 161.722 GiB (5.909 BPW)
|
| 40 |
Final estimate: PPL = 4.2213 +/- 0.02391
|
|
@@ -82,7 +82,7 @@ numactl -N 0 -m 0 \
|
|
| 82 |
</details>
|
| 83 |
|
| 84 |
## `IQ4_K` 134.183 GiB (4.903 BPW)
|
| 85 |
-
Final estimate: PPL =
|
| 86 |
|
| 87 |
<details>
|
| 88 |
|
|
|
|
| 34 |
* `bf16` 437.989 GiB (16.003 BPW)
|
| 35 |
- Final estimate: PPL = 4.1898 +/- 0.02367
|
| 36 |
* `Q8_0` 232.769 GiB (8.505 BPW)
|
| 37 |
+
- Final estimate: PPL = 4.1956 +/- 0.02371
|
| 38 |
|
| 39 |
## `IQ5_K` 161.722 GiB (5.909 BPW)
|
| 40 |
Final estimate: PPL = 4.2213 +/- 0.02391
|
|
|
|
| 82 |
</details>
|
| 83 |
|
| 84 |
## `IQ4_K` 134.183 GiB (4.903 BPW)
|
| 85 |
+
Final estimate: PPL = 4.2407 +/- 0.02406
|
| 86 |
|
| 87 |
<details>
|
| 88 |
|
images/perplexity.png
ADDED
|
Git LFS Details
|