mradermacher
/

loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned-GGUF

Text Generation

mixture-of-experts

instruction-following

Model card Files Files and versions

loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned-GGUF

3.01 GB

1 contributor

History: 3 commits

mradermacher's picture

uploaded from rich1

4193626 verified 4 months ago

.gitattributes

2.77 kB

uploaded from rich1 4 months ago
README.md

413 Bytes

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.IQ4_XS.gguf

197 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q2_K.gguf

153 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q3_K_L.gguf

186 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q3_K_M.gguf

179 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q3_K_S.gguf

172 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q4_K_M.gguf

210 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q4_K_S.gguf

204 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q5_K_M.gguf

236 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q5_K_S.gguf

233 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q6_K.gguf

264 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.Q8_0.gguf

340 MB
xet

uploaded from rich1 4 months ago
loggenix-moe-0.3B-A0.1B-e3-lr7e5-b16-4090-v5.1-finetuned.f16.gguf

635 MB
xet

uploaded from rich1 4 months ago