Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

mradermacher
/

Mellum-4b-sft-rust-i1-GGUF

Text Generation

text-generation-inference

fill-in-the-middle

Model card Files Files and versions

Mellum-4b-sft-rust-i1-GGUF

50.1 GB

1 contributor

History: 5 commits

mradermacher's picture

auto-patch README.md

338bcd0 verified 3 months ago

.gitattributes

3.26 kB

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ1_M.gguf

1.36 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ1_S.gguf

1.31 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ2_M.gguf

1.68 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ2_S.gguf

1.62 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ2_XS.gguf

1.52 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ2_XXS.gguf

1.44 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ3_M.gguf

2.03 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ3_S.gguf

1.95 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ3_XS.gguf

1.87 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ3_XXS.gguf

1.76 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ4_NL.gguf

2.34 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-IQ4_XS.gguf

2.25 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q2_K.gguf

1.71 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q2_K_S.gguf

1.66 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q3_K_L.gguf

2.24 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q3_K_M.gguf

2.12 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q3_K_S.gguf

1.95 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q4_0.gguf

2.35 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q4_1.gguf

2.58 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q4_K_M.gguf

2.61 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q4_K_S.gguf

2.45 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q5_K_M.gguf

2.98 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q5_K_S.gguf

2.86 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.i1-Q6_K.gguf

3.49 GB
xet

uploaded from rain 3 months ago
Mellum-4b-sft-rust.imatrix.gguf

3.23 MB
xet

uploaded from rain 3 months ago
README.md

6.24 kB

auto-patch README.md 3 months ago