geoffmunn/Qwen3-0.6B-f16 at 3ac653b71cfc45ef9d9e3f8fa9d9b9ede40801f7

4.96 GB

1 contributor

History: 96 commits

geoffmunn's picture

f16 path changed

3ac653b verified 14 days ago

Qwen3-0.6B-Q6_K
Notes updated 2 months ago
Qwen3-0.6B-f16-Q2_K
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q3_K_M
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q3_K_S
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q4_K_M
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q4_K_S
Rename Qwen3-0.6B-Q4_K_S/README.md to Qwen3-0.6B-f16-Q4_K_S/README.md 14 days ago
Qwen3-0.6B-f16-Q5_K_M
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q5_K_S
f16 path changed 14 days ago
Qwen3-0.6B-f16-Q8_0
f16 path changed 14 days ago
.gitattributes

2.89 kB

Upload qwen3-0.6b-imatrix.gguf 16 days ago
MODELFILE

522 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload 3 months ago
Q3_Quantisation_Comparison.md

10.6 kB

Update Q3_Quantisation_Comparison.md 16 days ago
Qwen3-0.6B-f16:Q2_K.gguf

347 MB
xet

Rename Qwen3-0.6B-f16-Q2_K.gguf to Qwen3-0.6B-f16:Q2_K.gguf 17 days ago
Qwen3-0.6B-f16:Q3_HIFI.gguf

329 MB
xet

Rename Qwen3-0.6B-f16-Q3_HIFI.gguf to Qwen3-0.6B-f16:Q3_HIFI.gguf 16 days ago
Qwen3-0.6B-f16:Q3_K_M.gguf

414 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_M.gguf to Qwen3-0.6B-f16:Q3_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q3_K_S.gguf

390 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_S.gguf to Qwen3-0.6B-f16:Q3_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q4_K_M.gguf

484 MB
xet

Rename Qwen3-0.6B-f16-Q4_K_M.gguf to Qwen3-0.6B-f16:Q4_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q4_K_S.gguf

471 MB
xet

Rename Qwen3-0.6B-f16-Q4_K_S.gguf to Qwen3-0.6B-f16:Q4_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q5_K_M.gguf

551 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_M.gguf to Qwen3-0.6B-f16:Q5_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q5_K_S.gguf

544 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_S.gguf to Qwen3-0.6B-f16:Q5_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q6_K.gguf

623 MB
xet

Rename Qwen3-0.6B-f16-Q6_K.gguf to Qwen3-0.6B-f16:Q6_K.gguf 17 days ago
Qwen3-0.6B-f16:Q8_0.gguf

805 MB
xet

Rename Qwen3-0.6B-f16-Q8_0.gguf to Qwen3-0.6B-f16:Q8_0.gguf 17 days ago
Qwen3-0.6b-f16-analysis.md

65 kB

FIle names fixed 16 days ago
README.md

5.13 kB

filename changed 14 days ago
SHA256SUMS.txt

831 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload 3 months ago
qwen3-0.6b-imatrix.gguf

1.18 MB
xet

Upload qwen3-0.6b-imatrix.gguf 16 days ago