Hugging Face's logo

fedora-copr
/
granite-3.2-8b-instruct-GGUF

Text Generation
Transformers
GGUF
English
language
granite-3.2
conversational
Model card Files
xet
Community

Granite-3.2-8B-Instruct-GGUF

Quantization of Granite-3.2-8B-Instruct by IBM for use in resource constrained environments.

Downloads last month
4
GGUF
Model size
8B params
Architecture
granite
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for fedora-copr/granite-3.2-8b-instruct-GGUF

Base model

ibm-granite/granite-3.1-8b-base
Finetuned
ibm-granite/granite-3.1-8b-instruct
Finetuned
ibm-granite/granite-3.2-8b-instruct
Quantized
(24)
this model