Edge-Quant/granite-4.0-micro-Q4_K_M-GGUF
3B
•
Updated
•
7
2. Mid-Range Devices Llm models
4-8 GB RAM
-
-
Edge-Quant/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 7 -
Edge-Quant/gemma-3n-E2B-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 52 • 1 -
Edge-Quant/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 60 -
Edge-Quant/VibeThinker-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 1 -
Edge-Quant/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 55 -
Edge-Quant/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 8 -
Edge-Quant/Gemmasutra-Mini-2B-v1-Q4_K_M-GGUF
3B • Updated • 249 • 2 -
Edge-Quant/AFM-4.5B-Q4_K_M-GGUF
5B • Updated • 6 -
Edge-Quant/Hunyuan-4B-Instruct-Q4_K_M-GGUF
4B • Updated • 13 -
Edge-Quant/Ministral-3b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 2 -
Edge-Quant/Ministral-3-3B-Reasoning-2512-Q4_K_M-GGUF
3B • Updated • 2 -
Edge-Quant/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation • 3B • Updated • 2 -
Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 16 -
Edge-Quant/SmolLM3-3B-Q4_K_M-GGUF
3B • Updated • 9 -
Edge-Quant/Qwen3-4B-Instruct-2507-Q4_K_M-GGUF
Text Generation • 4B • Updated • 5 -
Edge-Quant/Jan-v1-4B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 6 -
Edge-Quant/sarvam-1-Q4_K_M-GGUF
3B • Updated • 1 -
Edge-Quant/Nanbeige4-3B-Thinking-2511-Q4_K_M-GGUF
Text Generation • 4B • Updated • 12 -
Edge-Quant/Dolphin-v2-Q4_K_M-GGUF
Image-Text-to-Text • 3B • Updated • 18 -
Edge-Quant/YuLan-Mini-Q4_K_M-GGUF
Text Generation • 2B • Updated • 6 -
zhiyuan8/RWKV-v7-1.5B-G1-GGUF
Text Generation • 2B • Updated • 57 • 2 -
zhiyuan8/RWKV-v7-2.9B-G1-GGUF
Text Generation • 3B • Updated • 34 • 2 -
Edge-Quant/OpenReasoning-Nemotron-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 8