FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
76
lucky
lee5j
AI & ML interests
None yet
Recent Activity
updated
a model
about 1 month ago
lee5j/EXAONE-3.5-7.8B-Instruct-gptq-int8
published
a model
about 1 month ago
lee5j/EXAONE-3.5-7.8B-Instruct-gptq-int8
updated
a model
11 months ago
lee5j/Athene-V2-Agent-gptq4
Organizations
None yet
upvoted
a
collection
over 1 year ago