T,Model,Compression Recipe,PPL,ETHICS,Moral Stories,Moral Stories (Refusal),Histoires Morales,Histoires Morales (Refusal),RealToxicityPrompts,HarmBench,Links
🟢,Aya-expanse-8B,base,7.82,65.41,71.24,3.1,94.42,0.9,10.1,8.5,https://huggingface.co/CohereLabs/aya-expanse-8b
🔶,Aya-expanse-8B-Q,GPTQ 4-bit,8.03,58.04,68.35,3.7,42.28,6.7,11.3,9.5,https://huggingface.co/iproskurina/aya-expanse-8b-gptqmodel-4bit
🟢,Llama-3.1-8B-Instruct,base,6.99,60.21,95.44,0.1,94.17,0.2,3.0,12.5,https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct
🔶,Llama-3.1-8B-Instruct-Q,GPTQ 4-bit,7.22,58.64,99.97,0.0,93.63,0.3,3.4,12.5,https://huggingface.co/iproskurina/llama-3.1-8b-instruct-gptqmodel-4bit
🟢,Mistral-7B-Instruct-v0.3,base,5.75,68.70,95.27,0.0,93.33,0.0,6.3,29.5,https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3
🔶,Mistral-7B-Instruct-v0.3-Q,GPTQ 4-bit,5.80,70.27,95.79,0.0,93.83,0.0,7.5,41.5,https://huggingface.co/iproskurina/mistral-7b-instruct-v0.3-gptqmodel-4bit
🟢,Qwen2.5-7B-Instruct,base,7.14,73.41,91.94,0.3,88.56,0.6,4.0,3.0,https://huggingface.co/Qwen/Qwen2.5-7B-Instruct
🔶,Qwen2.5-7B-Instruct-Q,GPTQ 4-bit,7.31,72.64,94.32,0.1,88.42,0.7,4.1,2.5,https://huggingface.co/iproskurina/qwen2.5-7b-instruct-gptqmodel-4bit