unsloth
/

DeepSeek-V3.1-GGUF

Model card Files Files and versions

shimmyshimmer commited on Aug 23

Commit

5a9b23e

·

verified ·

1 Parent(s): 559359e

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -30,6 +30,7 @@ tags:
 </div>
 These quants include our Unsloth chat template fixes, specifically for llama.cpp supported backends.
 - Set the temperature **~0.6** (recommended) and Top_P value of **0.95** (recommended)
 - UD-Q2_K_XL (247GB) is recommended
 - For complete detailed instructions, see our guide: [unsloth.ai/blog/deepseek-v3.1](https://docs.unsloth.ai/basics/deepseek-v3.1)

 </div>
 These quants include our Unsloth chat template fixes, specifically for llama.cpp supported backends.
+- You must use --jinja for llama.cpp quants
 - Set the temperature **~0.6** (recommended) and Top_P value of **0.95** (recommended)
 - UD-Q2_K_XL (247GB) is recommended
 - For complete detailed instructions, see our guide: [unsloth.ai/blog/deepseek-v3.1](https://docs.unsloth.ai/basics/deepseek-v3.1)