mradermacher
/

Llama-3.2-SUN-2.5B-chat-i1-GGUF

Model card Files Files and versions

Llama-3.2-SUN-2.5B-chat-i1-GGUF

29 GB

1 contributor

History: 27 commits

mradermacher's picture

uploaded from nethype/db2

cd4e163 verified about 1 year ago

.gitattributes

3.29 kB

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ1_M.gguf

725 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ1_S.gguf

685 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ2_M.gguf

955 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ2_S.gguf

902 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ2_XS.gguf

850 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ2_XXS.gguf

792 MB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ3_M.gguf

1.2 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ3_XS.gguf

1.13 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ3_XXS.gguf

1.05 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-IQ4_XS.gguf

1.4 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q2_K.gguf

1.02 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q3_K_L.gguf

1.35 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q3_K_M.gguf

1.27 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q3_K_S.gguf

1.17 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_0.gguf

1.47 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_0_4_4.gguf

1.47 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_0_4_8.gguf

1.47 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_0_8_8.gguf

1.47 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_K_M.gguf

1.54 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q4_K_S.gguf

1.48 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q5_K_M.gguf

1.78 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q5_K_S.gguf

1.74 GB
xet

uploaded from nethype/db2 about 1 year ago
Llama-3.2-SUN-2.5B-chat.i1-Q6_K.gguf

2.04 GB
xet

uploaded from nethype/db2 about 1 year ago
README.md

246 Bytes

uploaded from nethype/db2 about 1 year ago
imatrix.dat

2.63 MB
xet

uploaded from nethype/db2 about 1 year ago