Hugging Face's logo

ubergarm
/
Kimi-K2-Instruct-GGUF

Text Generation
GGUF
mla
imatrix
conversational
ik_llama.cpp
Model card Files
xet
Community
7
Kimi-K2-Instruct-GGUF

Commit History

fixup README
bb58840

ubergarm commited on

ik_llama.cpp is back!
af30d8f

ubergarm commited on

add perplexity chart for v0.2 quants
5dc7c55

ubergarm commited on

Updated all recipes to v0.2 for best perplexity!
694ec54

ubergarm commited on

Upload folder using huggingface_hub
fb11740
verified

ubergarm commited on

Upload folder using huggingface_hub
75b8145
verified

ubergarm commited on

Upload folder using huggingface_hub
9c6fd8b
verified

ubergarm commited on

Upload folder using huggingface_hub
cb9b510
verified

ubergarm commited on

Upload folder using huggingface_hub
7e39110
verified

ubergarm commited on

Upload folder using huggingface_hub
7e6f19d
verified

ubergarm commited on

Upload folder using huggingface_hub
4caf893
verified

ubergarm commited on

prepping v0.2 release and IQ1_KT worlds smallest!
8f23292

ubergarm commited on

Upload folder using huggingface_hub
d76dcc6
verified

ubergarm commited on

Uploading IQ3_KS 427.205 GiB (3.573 BPW)
56823ba

ubergarm commited on

Upload folder using huggingface_hub
1e47d64
verified

ubergarm commited on

Ship it! IQ2_KS 286.624 GiB (2.398 BPW)
80e23aa

ubergarm commited on

Upload folder using huggingface_hub
c60ea55
verified

ubergarm commited on

Prepare upload IQ2_KS 286.624 GiB (2.398 BPW)
a9f71fa

ubergarm commited on

fixup readme and add example commands
95a692d

ubergarm commited on

Upload folder using huggingface_hub
ee847f5
verified

ubergarm commited on

uploading Kimi-K2-Instruct-IQ4_KS
ba0db48

ubergarm commited on

Add baseline Q8_0 PPL value
01a9e1f

ubergarm commited on

Finished IQ2_KL 345.687 GiB (2.892 BPW)
cceac6d

ubergarm commited on

Upload folder using huggingface_hub
7e9eeda
verified

ubergarm commited on

preparing for IQ2_KL 345.687 GiB (2.892 BPW)
3e1b88e

ubergarm commited on

Upload imatrix-Kimi-K2-Instruct-Q8_0.dat with huggingface_hub
dec8402
verified

ubergarm commited on

initial commit
a518c83

ubergarm commited on

initial commit
3d187fa
verified

ubergarm commited on