Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -51,12 +51,19 @@ Below are the perplexity scores for the EXL2 models. A lower score is better.
|
|
| 51 |
| 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
| 52 |
| 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
| 53 |
|
|
|
|
| 54 |
|
| 55 |
## EQ Bench
|
| 56 |
|
| 57 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
|
| 58 |
|
| 59 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
### Command-R-Plus Template
|
| 62 |
|
|
|
|
| 51 |
| 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
| 52 |
| 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
| 53 |
|
| 54 |
+
_TODO:_ Dracones quant perplexity scores being worked on.
|
| 55 |
|
| 56 |
## EQ Bench
|
| 57 |
|
| 58 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
|
| 59 |
|
| 60 |
+
| Quant Size | Alpaca | ChatML | Command-R | Command-R-Plus |
|
| 61 |
+
|------------|--------|--------|--------|--------|
|
| 62 |
+
| 6.0 | 70.77 | 62.58 | 75.81 | 74.95 |
|
| 63 |
+
| 5.0 | 69.51 | 63.94 | 74.92 | 75.28 |
|
| 64 |
+
|
| 65 |
+
|
| 66 |
+
_TODO:_ EQ Bench scores being worked on.
|
| 67 |
|
| 68 |
### Command-R-Plus Template
|
| 69 |
|