This is a MXFP4_MOE quantization of the model Granite-4.0-H-Small
Model quantized with BF16 GGUF's from: https://huggingface.co/unsloth/granite-4.0-h-small-GGUF
Original model: https://huggingface.co/ibm-granite/granite-4.0-h-small
- Downloads last month
- 217
Hardware compatibility
Log In
to view the estimation
4-bit
Model tree for noctrex/Granite-4.0-H-Small-MXFP4_MOE-GGUF
Base model
ibm-granite/granite-4.0-h-small