qwp4w3hyb
/

Hunyuan-A13B-Instruct-hf-WIP-GGUF

Text Generation

Model card Files Files and versions

qwp4w3hyb commited on Jun 30

Commit

0655bc9

·

verified ·

1 Parent(s): ad34443

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ pipeline_tag: text-generation
   - split bf16 parts: ~1~ ~2~ **3** 4
   - quants:
     - ~IQ4_XS~ **Q4_K_M** Q5_K_M Q6_K IQ4_NL IQ2_XXS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0
-- Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)
   - which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
 - supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)
   ```

   - split bf16 parts: ~1~ ~2~ **3** 4
   - quants:
     - ~IQ4_XS~ **Q4_K_M** Q5_K_M Q6_K IQ4_NL IQ2_XXS IQ3_XXS Q4_K_S Q5_K_S Q8_0 Q4_0
+- Based on [ngxson/llama.cpp/pull/26](https://github.com/ngxson/llama.cpp/pull/26)@[46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86](https://github.com/ngxson/llama.cpp/pull/26/commits/46c8b70cbc7346db95e45ebae4f1e0c68a9b8d86)
   - which is based on [ggml-org/llama.cpp/pull/14425](https://github.com/ggml-org/llama.cpp/pull/14425)
 - supposedly works *mostly fine*™ when run with below args according to [ggml-org/llama.cpp/pull/14425#issuecomment-3017533726](https://github.com/ggml-org/llama.cpp/pull/14425#issuecomment-3017533726)
   ```