Extreme Compression of Large Language Models via Additive Quantization
Paper
•
2401.06118
•
Published
•
14
YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
WARNING: this checkpoint might be obsolete. Please use the updated Mixtral checkpoint.
Official AQLM quantization of mistralai/Mixtral-8x7B-v0.1.
- Downloads last month
- 9