Dwq quant

#1
by sm54 - opened

Hi, I wonder if you plan to release a 4bit dwq variant of this model? The one for qwen 235b works very nicely.

Sign up or log in to comment