Tom Whitworth
twhitworth
AI & ML interests
Low Level Infrastructure, Tooling, Busyforking
Recent Activity
new activity
5 days ago
Intel/GLM-4.6-REAP-218B-A32B-FP8-gguf-q2ks-mixed-AutoRound:auto round version plz
new activity
5 days ago
Intel/Magistral-Small-2509-int4-AutoRound:Could we get more w2a16 w3a16 and w4a16 Autoround
liked
a model
13 days ago
cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit
Organizations
auto round version plz
#1 opened 5 days ago
by
twhitworth
Could we get more w2a16 w3a16 and w4a16 Autoround
1
#1 opened 5 days ago
by
twhitworth
Running on 6 GPUs
🤗
1
3
#10 opened 24 days ago
by
0xSero
v0.0.1
#1 opened about 1 month ago
by
twhitworth
Update README.md
#2 opened about 1 month ago
by
twhitworth
v0.2.0 Release
#6 opened 2 months ago
by
twhitworth
Happy to announce version v0.2.0 awq-w4a16
2
#5 opened 2 months ago
by
twhitworth
Question about model size
2
#4 opened 3 months ago
by
mhenning
Create README.md
2
#1 opened 3 months ago
by
twhitworth
gptq 8 please champs
1
#2 opened 3 months ago
by
groxaxo
repulled weights but getting this error assert hidden_states.dtype == torch.bfloat16, "hidden_states must be bfloat16"
1
#5 opened 3 months ago
by
bluenevus
getting a couple of errors " No model.safetensors.index.json found in remote" and "assert hidden_states.dtype == torch.bfloat16, "hidden_states must be bfloat16"
🤝
1
1
#1 opened 3 months ago
by
bluenevus
Upload 81 files
#4 opened 3 months ago
by
twhitworth
AWQ 4Bit / GPTQ with full precision gates and head? Please
8
#4 opened 4 months ago
by
chriswritescode
Large audio files
1
#7 opened 4 months ago
by
nherve
Semantic VAD?
1
#5 opened 4 months ago
by
twhitworth
Candle Support
1
#2 opened 5 months ago
by
Idealson
VRAM requirements
👍
1
1
#1 opened 5 months ago
by
twhitworth
Out of Mem for 4090-24G
👍
1
2
#1 opened 6 months ago
by
GUESSGUO
4a16 quant?
1
#1 opened 6 months ago
by
twhitworth