Qwen2.5-32B

ExLlamav2 8 bpw quant of https://huggingface.co/Qwen/Qwen2.5-32B

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for altomek/Qwen2.5-32B-8bpw-EXL2

Base model

Qwen/Qwen2.5-32B
Quantized
(77)
this model