hell0ks/Smoothie-Seed-OSS-36B-Instruct-AutoRound-GPTQ-4bit

Smoothie-qwen applied version of ByteDance-Seed/Seed-OSS-36B-Instruct

Tools used

• dnotitia/smoothie-qwen version: git+c005f0b

• intel/auto-round version: git+7b8e280

What is Smoothie-Qwen?

By analyzing and adjusting token weights particularly those associated with specific Unicode ranges it helps mitigate unintended biases toward certain languages while preserving the model’s core capabilities.

Generation command-line

auto-round --model seed-oss --scheme "W4A16" --format "auto_gptq" --output_dir "./seed-oss-gptq"