altomek
/

Deedlit_4B-GGUF

Model card Files Files and versions

Deedlit_4B

Llama.cpp Q4_0_4_4 quant of https://huggingface.co/FourOhFour/Deedlit_4B

Downloads last month: 39

GGUF

Model size

5B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

4-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Deedlit_4B-GGUF

Base model

FourOhFour/Deedlit_4B

Quantized

(3)

this model

Collection including altomek/Deedlit_4B-GGUF

Quants for ARM

11 items • Updated Jan 4 • 1