Hugging Face's logo

TheBloke
/
Nous-Capybara-3B-v1.9-GPTQ

Text Generation
Transformers
Safetensors
English
stablelm_epoch
sft
StableLM
custom_code
4-bit precision
gptq
Model card Files
xet
Community
2

Why only as GPTQ and not as GGUF as well ?

#1
by Pumba2 - opened
Discussion
Pumba2

as in the title, thanks

Pumba2 changed discussion title from Why only for GPTQ and not for GGUF ? to Why only for GPTQ and not for GGUF as well ?
Pumba2 changed discussion title from Why only for GPTQ and not for GGUF as well ? to Why only as GPTQ and not as GGUF as well ?
TheBloke
 Owner

StableLM is not supported by GGUF yet. https://github.com/ggerganov/llama.cpp/pull/3586

thracc

Could you add this now that it's supported? @TheBloke

Sign up or log in to comment