vikgrg
/

opt-125m-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

202 MB

1 contributor

History: 2 commits

vikgrg's picture

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False

14f581b verified 9 months ago

.gitattributes
1.52 kB

initial commit 9 months ago
config.json
1.06 kB

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 9 months ago
model.safetensors
202 MB
xet

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 9 months ago
quantize_config.json
266 Bytes

AutoGPTQ model for facebook/opt-125m: 4 bits, gr128, desc_act=False 9 months ago