YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Llamacpp Quantization of Qwenstien2.5-32B-Instruct
Original model https://huggingface.co/maldv/Qwenstein2.5-32B-Instruct
All thanks should go to the original model creator.
This is my first quantization of a model so if you find anything wrong with the quant please let me know.
- Downloads last month
- 17
Hardware compatibility
Log In
to view the estimation
4-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support