steampunque
/

Qwen3-32B-Hybrid-GGUF

4-bit precision

Model card Files Files and versions

steampunque commited on Jun 17

Commit

f5ab73f

·

verified ·

1 Parent(s): fdd84d7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -50,7 +50,7 @@ Full evals for Q4_K_H quant are available at https://huggingface.co/spaces/steam
 ## Download the file from below:
 | Link | Type | Size/e9 B | Notes |
 |------|------|-----------|-------|
-| [Qwen3-4B.Q8_0_H.gguf](https://huggingface.co/steampunque/Qwen3-32B-Hybrid-GGUF/resolve/main/Qwen3-32B.Q4_K_H.gguf) | Q4_K_H | 17.9e9 B | IQ4_XS+ quality |
 A discussion thread about the hybrid layer quant approach can be found here on the llama.cpp git repository:

 ## Download the file from below:
 | Link | Type | Size/e9 B | Notes |
 |------|------|-----------|-------|
+| [Qwen3-32B.Q4_K_H.gguf](https://huggingface.co/steampunque/Qwen3-32B-Hybrid-GGUF/resolve/main/Qwen3-32B.Q4_K_H.gguf) | Q4_K_H | 17.9e9 B | IQ4_XS+ quality |
 A discussion thread about the hybrid layer quant approach can be found here on the llama.cpp git repository: