marcsun13
/

opt-125m-awq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

ybelkada commited on Oct 30, 2023

Commit

aff7451

·

1 Parent(s): 5ce00fd

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -27,7 +27,7 @@
     "backend": "autoawq",
     "group_size": 128,
     "quant_method": "awq",
-    "version": "GEMM",
     "bits": 4,
     "zero_point": true
   },

     "backend": "autoawq",
     "group_size": 128,
     "quant_method": "awq",
+    "version": "gemm",
     "bits": 4,
     "zero_point": true
   },