321 GB

1 contributor

History: 25 commits

eaddario

Layer-wise quantization Q5_K_M

f3effd6 verified 6 months ago

imatrix
Generate imatrices 7 months ago
logits
Generate base model logits 7 months ago
scores
Add GGUF internal file structure 7 months ago
.gitattributes

1.6 kB

Update .gitattributes 7 months ago
.gitignore

6.78 kB

Add .gitignore 7 months ago
Qwen3-30B-A3B-F16-00001-of-00003.gguf

24.7 GB
xet

Convert safetensor to GGUF @ F16 7 months ago
Qwen3-30B-A3B-F16-00002-of-00003.gguf

24.9 GB
xet

Convert safetensor to GGUF @ F16 7 months ago
Qwen3-30B-A3B-F16-00003-of-00003.gguf

11.4 GB
xet

Convert safetensor to GGUF @ F16 7 months ago
Qwen3-30B-A3B-IQ3_M.gguf

14 GB
xet

Layer-wise quantization IQ3_M 7 months ago
Qwen3-30B-A3B-IQ3_S.gguf

13.3 GB
xet

Layer-wise quantization IQ3_S 7 months ago
Qwen3-30B-A3B-IQ4_NL.gguf

17.1 GB
xet

Layer-wise quantization IQ4_NL 7 months ago
Qwen3-30B-A3B-Q3_K_L.gguf

14.2 GB
xet

Layer-wise quantization Q3_K_L 7 months ago
Qwen3-30B-A3B-Q3_K_M.gguf

13.5 GB
xet

Layer-wise quantization Q3_K_M 7 months ago
Qwen3-30B-A3B-Q3_K_S.gguf

12.8 GB
xet

Layer-wise quantization Q3_K_S 7 months ago
Qwen3-30B-A3B-Q4_K_M.gguf

17.1 GB
xet

Layer-wise quantization Q4_K_M 7 months ago
Qwen3-30B-A3B-Q4_K_S.gguf

16.5 GB
xet

Layer-wise quantization Q4_K_S 7 months ago
Qwen3-30B-A3B-Q5_K_M.gguf

20.4 GB
xet

Layer-wise quantization Q5_K_M 6 months ago
Qwen3-30B-A3B-Q5_K_S.gguf

20.4 GB
xet

Layer-wise quantization Q5_K_S 6 months ago
Qwen3-30B-A3B-Q6_K.gguf

25.4 GB
xet

Layer-wise quantization Q6_K 6 months ago
Qwen3-30B-A3B-Q8_0.gguf

29.9 GB
xet

Layer-wise quantization Q8_0 6 months ago
README.md

19.8 kB

Update README.md 7 months ago