ExaltedSlayer

/

gemma-3-27b-it-qat-mlx-mxfp4

like 1

Sure, I will try it out. I just kicked off a quantization of it to mxfp4, I'll need to test it to make sure it doesn't lose vision capabilities, doing an mxfp4 quant of Gemma 27b initially lost vision, so it might not be ready tomorrow depending on how it goes, but hopefully early to mid next week :)

Thank you for your models!
I already try your phi4 - working very good!
I have a Mcabooc pro 16gb.
Could you be so kind to build gemma3-12b-it-qt mxfp4 please?

Thank you.

Check out ExaltedSlayer/gemma-3-12b-it-qat-mlx-mxfp4

Let me know if it works!

Thank you very much!!! I will test it and reply to you!

Absolutely! I did a short test with both text and photo. It accurately identified the stuff in the photo, so I think it's good.