s1arsky
/

WeirdCompound-v1.7-24b-EXL3

Model card Files Files and versions

Quantized using exllamav3 (0.0.5) quantization process.

Original model: FlareRebellion/WeirdCompound-v1.7-24b - refer for more details on the model.
exllamav3: https://github.com/turboderp-org/exllamav3

EXL3 quants available:

3.5bpw, 4bpw, 5.0bpw, 6bpw
Go to "Files and versions", then click on "Main" to choose your quant

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for s1arsky/WeirdCompound-v1.7-24b-EXL3

Base model

FlareRebellion/WeirdCompound-v1.7-24b

Quantized

(6)

this model