Hugging Face's logo

ubergarm
/
Kimi-K2-Thinking-GGUF

Text Generation
GGUF
mla
imatrix
conversational
ik_llama.cpp
Model card Files
xet
Community
14
Kimi-K2-Thinking-GGUF / README.md

Commit History

Add aider polyglot benchmark info and specific template
855780a

ubergarm commited on

finally upload smol-IQ3_KS
4aa771b

ubergarm commited on

uploading new recipe IQ3_K and update graph
b477b64

ubergarm commited on

uploading new IQ3_K and removing the old one
b20fd34

ubergarm commited on

Update readme
2a831b0

ubergarm commited on

add Q4_X notes as new baseline
a0ffddc

ubergarm commited on

upload Q4_X and add note before deleting Q8_0-Q4_0
053f8a7

ubergarm commited on

add smol-IQ2_KL
b105388

ubergarm commited on

upload IQ2_KL which is looking good
a2d5b08

ubergarm commited on

Add -amb 512 option in quick start command notes
4319c19

ubergarm commited on

Add note to update chat template and use --special
50e453e

ubergarm commited on

update perplexity graph with full Q8_0 baseline
62b4b9a

ubergarm commited on

smol-IQ4_KSS looks good despite supposed q4_0 QAT
a2ec5f8

ubergarm commited on

add perplexity graph as data completes
507a7ef

ubergarm commited on

uploading smol-IQ1_KT for the desperate
5b3c791

ubergarm commited on

uploading IQ3_K for the under 512GB crew
3ab9f0c

ubergarm commited on

update example commands
0bd9042

ubergarm commited on

add perplexity and stub out smol-IQ1_KT
16fe8c2

ubergarm commited on

fixup quant name lol
67744b8

ubergarm commited on

fixup ik_llama.cpp example command note
1881ca0

ubergarm commited on

add rough quick start commands
5b2c238

ubergarm commited on

Add 🫶
5484183

ubergarm commited on

add references and more info almost done uploading
e0e221d

ubergarm commited on

fixup readme
a391d75

ubergarm commited on

add model size 543.617 GiB (4.549 BPW)
c3bbf8e

ubergarm commited on

testing quant fork ik and mainline
395e6ac

ubergarm commited on