qwp4w3hyb commited on
Commit
3f4b466
·
verified ·
1 Parent(s): 76e434a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -10,9 +10,9 @@ pipeline_tag: text-generation
10
  # Alpha quality, needs WIP PR
11
 
12
  - upload **in progress**/~done~ Tracker
13
- - split bf16 parts: ~1~ ~2~ ~3~ **4**
14
  - quants:
15
- - ~IQ4_XS~ ~Q4_K_M~ ~Q5_K_M~ **Q6_K** Q8_0 Q4_0 Q4_K_S Q5_K_S
16
  - Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)@[46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86](https://github.com/ngxson/llama.cpp/pull/26/commits/46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86)
17
  - which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
18
  - supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)
 
10
  # Alpha quality, needs WIP PR
11
 
12
  - upload **in progress**/~done~ Tracker
13
+ - ~split bf16~
14
  - quants:
15
+ - ~IQ4_XS~ ~Q4_K_M~ ~Q5_K_M~ **Q6_K** **Q8_0** Q4_0 Q4_K_S Q5_K_S
16
  - Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)@[46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86](https://github.com/ngxson/llama.cpp/pull/26/commits/46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86)
17
  - which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
18
  - supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)