Static quantization of Noir-Blossom-12B
| File | Notes |
|---|---|
| Q6_K with select tensors quantized to Q8_0 7.23 bpw ~10% increase in size relative to Q6_K Quantized from BF16 Very close in fidelity to full precision |
- Downloads last month
- 3
Hardware compatibility
Log In
to view the estimation
6-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Valeciela/Noir-Blossom-12B-Q6_K_XL-GGUF
Base model
Vortex5/Noir-Blossom-12B