Models

allenai/olmOCR-2-7B-1025-FP8

Image-to-Text • 8B • Updated 12 days ago • 62.4k • 125

cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit

9B • Updated 3 days ago • 27.9k • 7

cerebras/GLM-4.6-REAP-218B-A32B-FP8

Text Generation • 218B • Updated 11 days ago • 880 • 34

zai-org/GLM-4.6-FP8

Text Generation • 358B • Updated 18 days ago • 644k • • 76

cpatonn/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit

Any-to-Any • 10B • Updated Sep 28 • 24.9k • 22

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-block

Text Generation • 109B • Updated 7 days ago • 219 • 3

cpatonn/Qwen3-VL-30B-A3B-Thinking-AWQ-4bit

6B • Updated 28 days ago • 1.7k • 4

RedHatAI/Qwen3-235B-A22B-Instruct-2507-NVFP4

Text Generation • 136B • Updated 4 days ago • 17 • 2

NandemoGHS/Anime-Speech-Japanese-Captioner-FP8-DYNAMIC

32B • Updated about 3 hours ago • 2

NandemoGHS/Anime-Speech-Japanese-Refiner-FP8-DYNAMIC

35B • Updated about 3 hours ago • 2

RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • 406B • Updated Dec 3, 2024 • 12 • 2

RedHatAI/Qwen2.5-1.5B-quantized.w8a8

Text Generation • 2B • Updated Dec 3, 2024 • 48.2k • 2

RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 357 • 3

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 40.9k • 9

jeffcookio/Mistral-Small-3.2-24B-Instruct-2506-awq-sym

5B • Updated Jul 4 • 4.2k • 8

t-tech/T-pro-it-2.0-AWQ

6B • Updated Jul 18 • 730 • 9

zai-org/GLM-4.5-FP8

Text Generation • 358B • Updated Aug 12 • 9.52k • 75

zai-org/GLM-4.5-Air-FP8

Text Generation • 111B • Updated Aug 12 • 108k • • 67

cpatonn/GLM-4.5-Air-AWQ-4bit

Text Generation • 19B • Updated Sep 2 • 165k • 18

cpatonn/GLM-4.5-AWQ-4bit

Text Generation • Updated Sep 2 • 160 • 1

cpatonn/Qwen3-4B-Instruct-2507-AWQ-4bit

Text Generation • 1B • Updated Aug 6 • 3.38k • 4

zai-org/GLM-4.5V-FP8

Image-Text-to-Text • 108B • Updated 9 days ago • 485k • • 35

cpatonn/GLM-4.5V-AWQ-4bit

Image-Text-to-Text • 19B • Updated Sep 2 • 734 • 3

RedHatAI/gpt-oss-120b-FP8-dynamic

Text Generation • 117B • Updated Aug 26 • 3.37k • 7

RedHatAI/Voxtral-Mini-3B-2507-FP8-dynamic

Automatic Speech Recognition • 5B • Updated 21 days ago • 456 • 8

scb10x/typhoon2.1-gemma3-12b-fp8

Text Generation • 13B • Updated Aug 31 • 303 • 1

tencent/Hunyuan-MT-7B-fp8

Translation • 8B • Updated Sep 2 • 13.6k • 26

cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit

Text Generation • Updated Sep 24 • 111k • 40

cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit

Text Generation • Updated Sep 20 • 23.8k • 14

cpatonn/Tongyi-DeepResearch-30B-A3B-AWQ-8bit

9B • Updated Sep 18 • 76 • 3