joongi007
/

Ko-Qwen2-7B-Instruct-GGUF

Model card Files Files and versions

joongi007 commited on Jun 17, 2024

Commit

cbf0b30

·

verified ·

1 Parent(s): e1a6bd0

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -18,4 +18,5 @@ model-index:
 {User}<|im_end|>
 <|im_start|>assistant
 {Assistant}
-```

 {User}<|im_end|>
 <|im_start|>assistant
 {Assistant}
+```
+"Flash Attention" function must be activated. [why?](https://www.reddit.com/r/LocalLLaMA/comments/1da19nu/if_your_qwen2_gguf_is_spitting_nonsense_enable/)