Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Qwen2.5-7B-Instruct-quantized.w8a8
like
2
Follow
Red Hat AI
1.63k
Text Generation
Safetensors
32 languages
qwen2
qwen
qwen2_5
qwen2_5_instruct
w8a8
int8
vllm
conversational
text-generation-inference
compressed-tensors
8-bit precision
arXiv:
2211.10438
arXiv:
2210.17323
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
main
Qwen2.5-7B-Instruct-quantized.w8a8
Commit History
Update README.md
9235f3e
verified
robgreenberg3
commited on
Sep 22
Update README.md
067c19e
verified
robgreenberg3
commited on
Sep 18
Update README.md
6b4b9f9
verified
robgreenberg3
commited on
Aug 26
Update README.md
ef83fcc
verified
robgreenberg3
commited on
May 30
Update README.md (
#2
)
d08f739
verified
robgreenberg3
commited on
May 20
Update README.md
750b734
verified
alexmarques
commited on
May 14
Create README.md
4689c1b
verified
alexmarques
commited on
Apr 16
Upload folder using huggingface_hub
9f62e45
verified
alexmarques
commited on
Oct 9, 2024
initial commit
4b27a9c
verified
alexmarques
commited on
Oct 9, 2024