QuantTrio
/

DeepSeek-V3.2-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

can this model be Quantized?

#4 opened about 1 hour ago by

Sadly, Amperes are not supported😢

#3 opened 12 days ago by

Did someone get it running on 4 NVIDIA RTX PRO 6000 Blackwell (96 GB) GPUs?

#2 opened 13 days ago by

Aww Man!

#1 opened 15 days ago by