Hugging Face's logo

legraphista
/
Qwen2-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files
xet
Community
legraphista commited on
Commit
a74d4ba
·
verified ·
1 Parent(s): 9f93c22

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -75,7 +75,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/blo
75
  | [Qwen2-72B-Instruct.Q8_0/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q8_0) | Q8_0 | 77.26GB | ✅ Available | ⚪ Static | ✂ Yes
76
  | [Qwen2-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q6_K) | Q6_K | 64.35GB | ✅ Available | ⚪ Static | ✂ Yes
77
  | [Qwen2-72B-Instruct.Q5_K/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q5_K) | Q5_K | 54.45GB | ✅ Available | ⚪ Static | ✂ Yes
78
- | Qwen2-72B-Instruct.Q5_K_S | Q5_K_S | - | ⏳ Processing | ⚪ Static | -
79
  | Qwen2-72B-Instruct.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
80
  | Qwen2-72B-Instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
81
  | Qwen2-72B-Instruct.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -
 
75
  | [Qwen2-72B-Instruct.Q8_0/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q8_0) | Q8_0 | 77.26GB | ✅ Available | ⚪ Static | ✂ Yes
76
  | [Qwen2-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q6_K) | Q6_K | 64.35GB | ✅ Available | ⚪ Static | ✂ Yes
77
  | [Qwen2-72B-Instruct.Q5_K/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q5_K) | Q5_K | 54.45GB | ✅ Available | ⚪ Static | ✂ Yes
78
+ | [Qwen2-72B-Instruct.Q5_K_S/*](https://huggingface.co/legraphista/Qwen2-72B-Instruct-IMat-GGUF/tree/main/Qwen2-72B-Instruct.Q5_K_S) | Q5_K_S | 51.38GB | ✅ Available | ⚪ Static | ✂ Yes
79
  | Qwen2-72B-Instruct.Q4_K | Q4_K | - | ⏳ Processing | 🟢 IMatrix | -
80
  | Qwen2-72B-Instruct.Q4_K_S | Q4_K_S | - | ⏳ Processing | 🟢 IMatrix | -
81
  | Qwen2-72B-Instruct.IQ4_NL | IQ4_NL | - | ⏳ Processing | 🟢 IMatrix | -