mlabonne

/

gemma-3-12b-it-abliterated-v2-GGUF

like 34

Yeah, Vision does not work, can you fix this?

Try this, does it work?
https://huggingface.co/koboldcpp/mmproj/blob/main/gemma3-12b-mmproj.gguf

The file "gemma3-12b-mmproj.gguf" must be renamed to "mmproj-model-f16.gguf" and stored in the same folder as the main GGUF file (gemma-3-12b-it-abliterated-v2.q8_0.gguf) to work in LM Studio.

The file "gemma3-12b-mmproj.gguf" must be renamed to "mmproj-model-f16.gguf" and stored in the same folder as the main GGUF file (gemma-3-12b-it-abliterated-v2.q8_0.gguf) to work in LM Studio.

1. Can vision work with the q4_k_m quant?

2. Would the same mmproj.gguf linked above work with the q4_k_m quant?