-
-
-
-
-
-
Inference Providers
Active filters:
4bit
sanchezalonsodavid17/DeepSeek-OCR-MBQ-Quantized-v1
Image-Text-to-Text
•
3B
•
Updated
•
261
•
4
ModelCloud/MiniMax-M2-GPTQMODEL-W4A16
Text Generation
•
229B
•
Updated
•
194
•
1
ModelCloud/Marin-32B-Base-GPTQMODEL-W4A16
Text Generation
•
33B
•
Updated
•
9
•
1
ModelCloud/Marin-32B-Base-GPTQMODEL-AWQ-W4A16
Text Generation
•
33B
•
Updated
•
26
•
1
sweatSmile/Phi3-Mini-FinSight-FinancialQA
Text Generation
•
4B
•
Updated
•
15
•
1
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
•
4B
•
Updated
•
6.65k
•
22
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
4
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
8
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
1
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
1
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
3
•
1
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
1
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
•
8
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
•
2
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
•
3
CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA
Text Generation
•
Updated
•
1
SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
4
•
8
SebastianSchramm/UniNER-7B-type-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
7
•
1
SebastianSchramm/UniNER-7B-definition-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
2
•
1
SebastianSchramm/UniNER-7B-type-sup-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
4
Sanrove/gpt2-GPTQ-4b
Text Generation
•
Updated
•
2
kingabzpro/zephyr-7b-beta-Agent-Instruct
Text Generation
•
Updated
•
3
•
1
SebastianSchramm/LlamaGuard-7b-GPTQ-4bit-128g-actorder_True
Text Generation
•
1B
•
Updated
•
1
•
2
A2H0H0R1/Qwen-7B-Chat-Int4-Qlora-biology
Text Generation
•
Updated
kingabzpro/phi-2-role-play
Text Generation
•
Updated
•
4
ecastera/eva-mistral-7b-spanish-GGUF
7B
•
Updated
•
130
•
9