Vortex
Collection
ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize
•
24 items
•
Updated
•
10
This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.
SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|-------------------------------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_challenge | 1|none | 0|acc |↑ |0.5828|± |0.0144|
| | |none | 0|acc_norm|↑ |0.6007|± |0.0143|
|mmlu (stem) | 2|none | |acc |↑ |0.6673|± |0.0080|
| - abstract_algebra | 1|none | 0|acc |↑ |0.4200|± |0.0496|
| - anatomy | 1|none | 0|acc |↑ |0.7185|± |0.0389|
| - astronomy | 1|none | 0|acc |↑ |0.8553|± |0.0286|
| - college_biology | 1|none | 0|acc |↑ |0.8681|± |0.0283|
| - college_chemistry | 1|none | 0|acc |↑ |0.5300|± |0.0502|
| - college_computer_science | 1|none | 0|acc |↑ |0.6300|± |0.0485|
| - college_mathematics | 1|none | 0|acc |↑ |0.4800|± |0.0502|
| - college_physics | 1|none | 0|acc |↑ |0.5686|± |0.0493|
| - computer_security | 1|none | 0|acc |↑ |0.7800|± |0.0416|
| - conceptual_physics | 1|none | 0|acc |↑ |0.7660|± |0.0277|
| - electrical_engineering | 1|none | 0|acc |↑ |0.7379|± |0.0366|
| - elementary_mathematics | 1|none | 0|acc |↑ |0.6296|± |0.0249|
| - high_school_biology | 1|none | 0|acc |↑ |0.8710|± |0.0191|
| - high_school_chemistry | 1|none | 0|acc |↑ |0.6453|± |0.0337|
| - high_school_computer_science| 1|none | 0|acc |↑ |0.7800|± |0.0416|
| - high_school_mathematics | 1|none | 0|acc |↑ |0.4481|± |0.0303|
| - high_school_physics | 1|none | 0|acc |↑ |0.5166|± |0.0408|
| - high_school_statistics | 1|none | 0|acc |↑ |0.6620|± |0.0323|
| - machine_learning | 1|none | 0|acc |↑ |0.5714|± |0.0470|
Base model
marin-community/marin-32b-base