VPTQ-community

community

AI & ML interests

None defined yet.

OpenSourceRonin

in VPTQ-community/README 4 months ago

using VPTQ for my own models

#3 opened 4 months ago by

OpenSourceRonin

updated 19 models 8 months ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

6B • Updated Mar 20 • 1

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

2B • Updated Mar 20 • 27

VPTQ-community/Meta-Llama-3-70B-v16-k65536-65536-woft

8B • Updated Mar 20 • 1

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-woft

6B • Updated Mar 20

VPTQ-community/Meta-Llama-3-70B-v12-k4096-4096-ft

6B • Updated Mar 20 • 2

VPTQ-community/Meta-Llama-3-8B-v12-k4096-4096-woft

2B • Updated Mar 20 • 1

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-256-woft

3B • Updated Mar 20 • 23

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-65536-woft

4B • Updated Mar 20 • 27

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20 • 29

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-65536-woft

2B • Updated Mar 20 • 33

VPTQ-community/Qwen2.5-14B-Instruct-v8-k65536-0-woft

3B • Updated Mar 20 • 23

VPTQ-community/Qwen2.5-14B-Instruct-v16-k65536-65536-woft

3B • Updated Mar 20 • 54

VPTQ-community/Meta-Llama-3-8B-v6-k4096-4096-woft

2B • Updated Mar 20 • 6

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20 • 107 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

2B • Updated Mar 20 • 40

VPTQ-community/Qwen2.5-14B-Instruct-v8-k256-256-woft

2B • Updated Mar 20 • 32

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

2B • Updated Mar 20 • 28

VPTQ-community/Meta-Llama-3-8B-v4-k4096-0-woft

2B • Updated Mar 20 • 2

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

2B • Updated Mar 20 • 49