--- license: mit base_model: - ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501 base_model_relation: quantized pipeline_tag: text-generation library_name: safetensors tags: - exl3 - 4-bit - 6-bit - 8-bit --- ## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/Zero-Mistral-Small-24B-Instruct-2501_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Zero-Mistral-Small-24B-Instruct-2501_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Zero-Mistral-Small-24B-Instruct-2501_EXL3/tree/H8-8.0BPW) ] # Original model: [Zero-Mistral-Small-24B-Instruct-2501](https://huggingface.co/ZeroAgency/Zero-Mistral-Small-24B-Instruct-2501) by [ZeroAgency](https://huggingface.co/ZeroAgency)