mradermacher
/

openbuddy-llama3.2-1b-v23.1-131k-i1-GGUF

Model card Files Files and versions

openbuddy-llama3.2-1b-v23.1-131k-i1-GGUF

19 GB

1 contributor

History: 7 commits

mradermacher's picture

auto-patch README.md

4605ae9 verified 4 months ago

.gitattributes

3.57 kB

uploaded from leia 8 months ago
README.md

6.42 kB

auto-patch README.md 4 months ago
imatrix.dat

1.31 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ1_M.gguf

500 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ1_S.gguf

480 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_M.gguf

628 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_S.gguf

602 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_XS.gguf

562 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_XXS.gguf

533 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_M.gguf

770 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_S.gguf

757 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_XS.gguf

734 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_XXS.gguf

675 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ4_NL.gguf

921 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ4_XS.gguf

883 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q2_K.gguf

667 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q2_K_S.gguf

641 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_L.gguf

845 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_M.gguf

804 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_S.gguf

755 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_0.gguf

921 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_1.gguf

996 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_K_M.gguf

955 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_K_S.gguf

923 MB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q5_K_M.gguf

1.09 GB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q5_K_S.gguf

1.07 GB
xet

uploaded from leia 8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q6_K.gguf

1.24 GB
xet

uploaded from leia 8 months ago