Update README.md
Browse files
README.md
CHANGED
|
@@ -10,9 +10,9 @@ pipeline_tag: text-generation
|
|
| 10 |
# Alpha quality, needs WIP PR
|
| 11 |
|
| 12 |
- upload **in progress**/~done~ Tracker
|
| 13 |
-
- split bf16
|
| 14 |
- quants:
|
| 15 |
-
- ~IQ4_XS~ ~Q4_K_M~ ~Q5_K_M~ **Q6_K** Q8_0 Q4_0 Q4_K_S Q5_K_S
|
| 16 |
- Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)@[46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86](https://github.com/ngxson/llama.cpp/pull/26/commits/46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86)
|
| 17 |
- which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
|
| 18 |
- supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)
|
|
|
|
| 10 |
# Alpha quality, needs WIP PR
|
| 11 |
|
| 12 |
- upload **in progress**/~done~ Tracker
|
| 13 |
+
- ~split bf16~
|
| 14 |
- quants:
|
| 15 |
+
- ~IQ4_XS~ ~Q4_K_M~ ~Q5_K_M~ **Q6_K** **Q8_0** Q4_0 Q4_K_S Q5_K_S
|
| 16 |
- Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)@[46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86](https://github.com/ngxson/llama.cpp/pull/26/commits/46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86)
|
| 17 |
- which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
|
| 18 |
- supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)
|