Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,30 @@ This model is done with mergekitty. With a couple of code patch to add qwen3 and
|
|
| 26 |
|
| 27 |
I used `TIES`. Not because I'm lazy but because it's what I had lying around that isn't `SCE` or something else.
|
| 28 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
## Merge Details
|
| 30 |
### Merge Method
|
| 31 |
|
|
|
|
| 26 |
|
| 27 |
I used `TIES`. Not because I'm lazy but because it's what I had lying around that isn't `SCE` or something else.
|
| 28 |
|
| 29 |
+
## Model Results (Thanks to [@SmerkyG](/SmerkyG))
|
| 30 |
+
|
| 31 |
+
| Tasks |Version|Filter|n-shot|Metric| |Value | |Stderr|
|
| 32 |
+
|---------------------------------------|------:|------|-----:|------|---|-----:|---|-----:|
|
| 33 |
+
|mmlu | 2|none | |acc |↑ |0.7478|± |0.0034|
|
| 34 |
+
|
| 35 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 36 |
+
|--------------|------:|------|-----:|----------|---|-----:|---|-----:|
|
| 37 |
+
|arc_challenge | 1|none | 0|acc |↑ |0.5392|± |0.0146|
|
| 38 |
+
| | |none | 0|acc_norm |↑ |0.5768|± |0.0144|
|
| 39 |
+
|arc_easy | 1|none | 0|acc |↑ |0.8178|± |0.0079|
|
| 40 |
+
| | |none | 0|acc_norm |↑ |0.7963|± |0.0083|
|
| 41 |
+
|hellaswag | 1|none | 0|acc |↑ |0.5906|± |0.0049|
|
| 42 |
+
| | |none | 0|acc_norm |↑ |0.7868|± |0.0041|
|
| 43 |
+
|lambada_openai| 1|none | 0|acc |↑ |0.7357|± |0.0061|
|
| 44 |
+
| | |none | 0|perplexity|↓ |3.3203|± |0.0674|
|
| 45 |
+
|piqa | 1|none | 0|acc |↑ |0.7933|± |0.0094|
|
| 46 |
+
| | |none | 0|acc_norm |↑ |0.7922|± |0.0095|
|
| 47 |
+
|sciq | 1|none | 0|acc |↑ |0.9630|± |0.0060|
|
| 48 |
+
| | |none | 0|acc_norm |↑ |0.9570|± |0.0064|
|
| 49 |
+
|winogrande | 1|none | 0|acc |↑ |0.7182|± |0.0126|
|
| 50 |
+
|
| 51 |
+
|
| 52 |
+
|
| 53 |
## Merge Details
|
| 54 |
### Merge Method
|
| 55 |
|