geoffmunn/Qwen3-0.6B-f16 at 099c2cce9d3688aea40d14e5de9b514205a1a55e

4.96 GB

1 contributor

History: 84 commits

geoffmunn's picture

Upload qwen3-0.6b-imatrix.gguf

099c2cc verified 16 days ago

Qwen3-0.6B-Q2_K
Notes updated 2 months ago
Qwen3-0.6B-Q3_K_M
Notes updated 2 months ago
Qwen3-0.6B-Q3_K_S
Notes updated 2 months ago
Qwen3-0.6B-Q4_K_M
Notes updated 2 months ago
Qwen3-0.6B-Q4_K_S
Notes updated 2 months ago
Qwen3-0.6B-Q5_K_M
Notes updated 2 months ago
Qwen3-0.6B-Q5_K_S
Notes updated 2 months ago
Qwen3-0.6B-Q6_K
Notes updated 2 months ago
Qwen3-0.6B-Q8_0
Notes updated 2 months ago
.gitattributes

2.89 kB

Upload qwen3-0.6b-imatrix.gguf 16 days ago
MODELFILE

522 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload 3 months ago
Q3_Quantisation_Comparison.md

10.6 kB

Update Q3_Quantisation_Comparison.md 16 days ago
Qwen3-0.6B-f16:Q2_K.gguf

347 MB
xet

Rename Qwen3-0.6B-f16-Q2_K.gguf to Qwen3-0.6B-f16:Q2_K.gguf 17 days ago
Qwen3-0.6B-f16:Q3_HIFI.gguf

329 MB
xet

Rename Qwen3-0.6B-f16-Q3_HIFI.gguf to Qwen3-0.6B-f16:Q3_HIFI.gguf 16 days ago
Qwen3-0.6B-f16:Q3_K_M.gguf

414 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_M.gguf to Qwen3-0.6B-f16:Q3_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q3_K_S.gguf

390 MB
xet

Rename Qwen3-0.6B-f16-Q3_K_S.gguf to Qwen3-0.6B-f16:Q3_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q4_K_M.gguf

484 MB
xet

Rename Qwen3-0.6B-f16-Q4_K_M.gguf to Qwen3-0.6B-f16:Q4_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q4_K_S.gguf

471 MB
xet

Rename Qwen3-0.6B-f16-Q4_K_S.gguf to Qwen3-0.6B-f16:Q4_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q5_K_M.gguf

551 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_M.gguf to Qwen3-0.6B-f16:Q5_K_M.gguf 17 days ago
Qwen3-0.6B-f16:Q5_K_S.gguf

544 MB
xet

Rename Qwen3-0.6B-f16-Q5_K_S.gguf to Qwen3-0.6B-f16:Q5_K_S.gguf 17 days ago
Qwen3-0.6B-f16:Q6_K.gguf

623 MB
xet

Rename Qwen3-0.6B-f16-Q6_K.gguf to Qwen3-0.6B-f16:Q6_K.gguf 17 days ago
Qwen3-0.6B-f16:Q8_0.gguf

805 MB
xet

Rename Qwen3-0.6B-f16-Q8_0.gguf to Qwen3-0.6B-f16:Q8_0.gguf 17 days ago
Qwen3-0.6b-analysis.md

64.9 kB

Layout updated 25 days ago
README.md

5.1 kB

Models highlighted 2 months ago
SHA256SUMS.txt

831 Bytes

Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload 3 months ago
qwen3-0.6b-imatrix.gguf

1.18 MB
xet

Upload qwen3-0.6b-imatrix.gguf 16 days ago