Can you do the newest deep seek models???

#1
by rombodawg - opened
Moxin Organization org

Thanks for your question! DeepSeek V3.2 uses a new architecture DeepseekV32ForCausalLM that is different from V3 / V3.1, so it’s not a drop-in replacement for the current implementation. As far as we know, contributors in the broader llama.cpp community are actively exploring support for the new modules llama.cpp/issues/16331. We’ll keep an eye on the progress and will try it out as soon as it becomes feasible.

Sign up or log in to comment