TheBloke
/

WizardLM-30B-Uncensored-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

TheBloke commited on May 22, 2023

Commit

8c93c34

·

1 Parent(s): 448a888

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -43,7 +43,7 @@ This will work with all versions of GPTQ-for-LLaMa. It has maximum compatibility
 It was created without the `--act-order` parameter. It may have slightly lower inference quality compared to the other file, but is guaranteed to work on all versions of GPTQ-for-LLaMa and text-generation-webui.
-* `wizard-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with AutoGPTQ. Use `strict=False` to load.
   * Works with text-generation-webui one-click-installers

 It was created without the `--act-order` parameter. It may have slightly lower inference quality compared to the other file, but is guaranteed to work on all versions of GPTQ-for-LLaMa and text-generation-webui.
+* `WizardLM-30B-uncensored-GPTQ-4bit.act-order.safetensors`
   * Works with all versions of GPTQ-for-LLaMa code, both Triton and CUDA branches
   * Works with AutoGPTQ. Use `strict=False` to load.
   * Works with text-generation-webui one-click-installers