Hugging Face's logo

legraphista
/
Qwen2-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
imatrix
quantization
imat
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files
xet
Community
legraphista commited on
Commit
26405e3
·
verified ·
1 Parent(s): 9b1c19b

Upload Qwen2-72B-Instruct.Q3_K.gguf with huggingface_hub

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Qwen2-72B-Instruct.Q3_K.gguf +3 -0
.gitattributes CHANGED
@@ -60,3 +60,4 @@ Qwen2-72B-Instruct.Q5_K_S/Qwen2-72B-Instruct.Q5_K_S-00002-of-00002.gguf filter=l
60
  Qwen2-72B-Instruct.Q5_K_S/Qwen2-72B-Instruct.Q5_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
61
  Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
 
 
60
  Qwen2-72B-Instruct.Q5_K_S/Qwen2-72B-Instruct.Q5_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
61
  Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
62
  Qwen2-72B-Instruct.Q4_K/Qwen2-72B-Instruct.Q4_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Qwen2-72B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2-72B-Instruct.Q3_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98d6c66f6914104059557fe8efef538a662124cacf445c4ffe413f9ca49c20a7
3
+ size 37698722528