AWQ quants - a sairampillai Collection

sairampillai 's Collections

AWQ quants

updated Jan 28

AWQ quants of various leading models for benchmarks and testing

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • 0.6B • Updated Oct 9, 2024 • 84.5k • 6
Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • 1.0B • Updated Oct 9, 2024 • 6.18k • 14
Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • 2B • Updated Oct 9, 2024 • 664k • 32
Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • 3B • Updated Oct 9, 2024 • 358k • 27
Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • 1B • Updated Sep 21, 2024 • 1.31k • 24
Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • 3B • Updated Sep 25, 2024 • 80k • 49
Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • 3B • Updated Jan 12 • 61.9k • 12
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 220k • 79
TheBloke/Mixtral_11Bx2_MoE_19B-AWQ

Text Generation • 3B • Updated Jan 5, 2024 • 5 • 5
TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ

Text Generation • 0.3B • Updated Dec 31, 2023 • 1.07k • 6
internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2, 2024 • 59 • 5
hugging-quants/gemma-2-9b-it-AWQ-INT4

Text Generation • 2B • Updated Oct 17, 2024 • 2.36k • 6
casperhansen/deepseek-r1-distill-qwen-7b-awq

2B • Updated Feb 8 • 516 • 8
casperhansen/deepseek-r1-distill-llama-8b-awq

2B • Updated Feb 8 • 509 • 3
casperhansen/deepseek-r1-distill-qwen-14b-awq

3B • Updated Feb 8 • 41k • 13