153 GB

1 contributor

History: 15 commits

ubergarm

Add IQ4_KT for full GPU offload

3f0415f 4 months ago

images
add perplexity graphs 4 months ago
.gitattributes

1.65 kB

initial commit 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ1_KT.gguf

8.15 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ1_KT.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ2_KL.gguf

12.4 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ2_KL.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ2_KT.gguf

10.2 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ2_KT.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ3_K.gguf

15.6 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ3_K.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ3_KS.gguf

14.6 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ3_KS.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ4_K.gguf

19.2 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ4_K.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ4_KSS.gguf

16.7 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ4_KSS.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ4_KT.gguf

15.5 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ4_KT.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-IQ5_K.gguf

22.9 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-IQ5_K.gguf with huggingface_hub 4 months ago
Qwen3-30B-A3B-Thinking-2507-Q4_0.gguf

17.3 GB
xet

Upload Qwen3-30B-A3B-Thinking-2507-Q4_0.gguf with huggingface_hub 4 months ago
README.md

16.2 kB

Add IQ4_KT for full GPU offload 4 months ago
imatrix-eaddario-combined-all-medium-Qwen3-30B-A3B-Thinking-2507-BF16.dat

122 MB
xet

Upload imatrix-eaddario-combined-all-medium-Qwen3-30B-A3B-Thinking-2507-BF16.dat with huggingface_hub 4 months ago