ik_llama.cpp is back!
Browse files
README.md
CHANGED
|
@@ -14,9 +14,7 @@ tags:
|
|
| 14 |
---
|
| 15 |
|
| 16 |
## `ik_llama.cpp` imatrix Quantizations of moonshotai/Kimi-K2-Instruct
|
| 17 |
-
This quant collection **REQUIRES** [
|
| 18 |
-
|
| 19 |
-
*NOTE* `ikawrakow's fork ik_llama.cpp` was removed from github for unknown reasons, still sorting that out follow along this reddit thread: https://www.reddit.com/r/LocalLLaMA/comments/1m4vw29/ikllamacpp_repository_gone_or_it_is_only_me/
|
| 20 |
|
| 21 |
*NOTE* `ik_llama.cpp` can also run your existing GGUFs from bartowski, unsloth, mradermacher, etc if you want to try it out before downloading my quants.
|
| 22 |
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
## `ik_llama.cpp` imatrix Quantizations of moonshotai/Kimi-K2-Instruct
|
| 17 |
+
This quant collection **REQUIRES** [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp/) fork to support the ik's latest SOTA quants and optimizations! Do **not** download these big files and expect them to run on mainline vanilla llama.cpp, ollama, LM Studio, KoboldCpp, etc!
|
|
|
|
|
|
|
| 18 |
|
| 19 |
*NOTE* `ik_llama.cpp` can also run your existing GGUFs from bartowski, unsloth, mradermacher, etc if you want to try it out before downloading my quants.
|
| 20 |
|