Zheng Han

traphix's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen3-Next-80B-A3B-Instruct-FP8 about 2 months ago

Error on 4 x L40s

➕ 2

1

#4 opened about 2 months ago by

traphix

I got ValueError

👀 2

10

#3 opened about 2 months ago by

spow12

New activity in shanjiaz/qwen3-80b-fp8-dynamic about 2 months ago

How to run this model via vllm？

11

#2 opened 2 months ago by

traphix

New activity in Qwen/Qwen3-Next-80B-A3B-Instruct about 2 months ago

FP8 please

👀 ➕ 16

8

#18 opened 2 months ago by

aliquis-pe

New activity in DevQuasar/Qwen.Qwen3-Next-80B-A3B-Instruct-FP8-Dynamic about 2 months ago

vllm v0.10.2 error

❤️ 1

#2 opened about 2 months ago by

traphix

New activity in DevQuasar/Qwen.Qwen3-Next-80B-A3B-Instruct-FP8 2 months ago

VLLM compatibility?

9

#1 opened 2 months ago by

aidendle94

New activity in shanjiaz/qwen3-80b-fp8-dynamic 2 months ago

Instruct or Thinking?

#1 opened 2 months ago by

traphix

New activity in DevQuasar/Qwen.Qwen3-Next-80B-A3B-Instruct-FP8-Dynamic 2 months ago

Could you share your quantization code？

1

#1 opened 2 months ago by

traphix

New activity in nm-testing/qwen3-80b-fp8-dynamic 2 months ago

Instruct or thinking？

#1 opened 2 months ago by

traphix

New activity in RedHatAI/Qwen3-8B-FP8-dynamic 3 months ago

Any plans to quantize Qwen3-235B-A22B-Instruct-2507？

#1 opened 3 months ago by

traphix

New activity in chriswritescode/Qwen3-235B-A22B-Instruct-2507-AWQ-Swift 4 months ago

Qwen3-235B-A22B-Instruct-2507, int4-w4a16 or awq? Which one has better accuracy recovery?

1

#1 opened 4 months ago by

traphix

New activity in Qwen/Qwen2.5-14B-Instruct-1M 4 months ago

Does vllm 0.7.3 support this model？

1

#10 opened 9 months ago by

traphix

New activity in RedHatAI/README 4 months ago

Any plans to quantize Qwen3-235B-A22B-Instruct-2507？

#1 opened 4 months ago by

traphix

New activity in RedHatAI/DeepSeek-R1-0528-quantized.w4a16 6 months ago

Is 4 x H20 96G sufficient to run this model?

2

#2 opened 6 months ago by

milongwong

New activity in Qwen/Qwen3-30B-A3B-FP8 6 months ago

Remove vLLM FP8 Limitation

10

#2 opened 7 months ago by

simon-mo

New activity in RedHatAI/Qwen3-235B-A22B-FP8-dynamic 6 months ago

Error running on A100?

2

#4 opened 6 months ago by

traphix

Any plans for int8 quantized.w8a8?

#5 opened 6 months ago by

traphix

New activity in justinjja/Qwen3-235B-A22B-INT4-W4A16 6 months ago

How about int8 quantization?

#3 opened 6 months ago by

traphix

New activity in RedHatAI/Qwen3-235B-A22B-FP8-dynamic 6 months ago

How many RAM in GBs when quantizing Qwen3-235B-A22B?

#2 opened 6 months ago by

traphix

liked a model 6 months ago

RedHatAI/Qwen3-235B-A22B-FP8-dynamic

Text Generation • 235B • Updated May 6 • 354 • 2