Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
openbuddy-llama3.2-1b-v23.1-131k-i1-GGUF
like
0
Transformers
GGUF
8 languages
llama-3.2
imatrix
conversational
License:
llama3.2
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
openbuddy-llama3.2-1b-v23.1-131k-i1-GGUF
19 GB
1 contributor
History:
7 commits
mradermacher
auto-patch README.md
4605ae9
verified
4 months ago
.gitattributes
3.57 kB
uploaded from leia
8 months ago
README.md
6.42 kB
auto-patch README.md
4 months ago
imatrix.dat
1.31 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ1_M.gguf
500 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ1_S.gguf
480 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_M.gguf
628 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_S.gguf
602 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_XS.gguf
562 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ2_XXS.gguf
533 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_M.gguf
770 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_S.gguf
757 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_XS.gguf
734 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ3_XXS.gguf
675 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ4_NL.gguf
921 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-IQ4_XS.gguf
883 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q2_K.gguf
667 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q2_K_S.gguf
641 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_L.gguf
845 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_M.gguf
804 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q3_K_S.gguf
755 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_0.gguf
921 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_1.gguf
996 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_K_M.gguf
955 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q4_K_S.gguf
923 MB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q5_K_M.gguf
1.09 GB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q5_K_S.gguf
1.07 GB
xet
uploaded from leia
8 months ago
openbuddy-llama3.2-1b-v23.1-131k.i1-Q6_K.gguf
1.24 GB
xet
uploaded from leia
8 months ago