Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
geoffmunn
/
Qwen3-0.6B-f16
like
1
Text Generation
GGUF
English
Chinese
qwen
qwen3
qwen3-0.6b
qwen3-0.6b-gguf
llama.cpp
quantized
chat
edge-ai
tiny-model
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
7880ae3
Qwen3-0.6B-f16
4.63 GB
1 contributor
History:
23 commits
geoffmunn
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
7880ae3
verified
3 months ago
Qwen3-0.6B-Q2_K
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q3_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q3_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q4_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q4_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q5_K_M
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q5_K_S
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q6_K
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-Q8_0
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
.gitattributes
Safe
2.08 kB
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
MODELFILE
Safe
522 Bytes
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q2_K.gguf
Safe
347 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q3_K_M.gguf
Safe
414 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q3_K_S.gguf
Safe
390 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q4_K_M.gguf
Safe
484 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q4_K_S.gguf
Safe
471 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q5_K_M.gguf
Safe
551 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q5_K_S.gguf
Safe
544 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q6_K.gguf
Safe
623 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
Qwen3-0.6B-f16:Q8_0.gguf
Safe
805 MB
xet
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
README.md
Safe
4 kB
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, CLI examples, and auto-upload
3 months ago
SHA256SUMS.txt
Safe
831 Bytes
Add Q2–Q8_0 quantized models with per-model cards, MODELFILE, and auto-upload
3 months ago
