Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
prometheus-8x7b-v2.0-i1-GGUF
like
2
Transformers
GGUF
prometheus-eval/Feedback-Collection
prometheus-eval/Preference-Collection
English
text2text-generation
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
687c2e1
prometheus-8x7b-v2.0-i1-GGUF
385 GB
1 contributor
History:
21 commits
mradermacher
uploaded from nico1
687c2e1
verified
12 months ago
.gitattributes
2.86 kB
uploaded from nico1
12 months ago
README.md
Safe
244 Bytes
uploaded from nico1
12 months ago
imatrix.dat
25.7 MB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ1_M.gguf
10.8 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ1_S.gguf
Safe
9.82 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ2_M.gguf
15.5 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ2_S.gguf
Safe
14.1 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ2_XS.gguf
Safe
13.9 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ2_XXS.gguf
12.6 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ3_M.gguf
Safe
21.4 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ3_XXS.gguf
18.2 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-IQ4_XS.gguf
25.1 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q2_K.gguf
17.3 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q3_K_L.gguf
Safe
24.2 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q3_K_M.gguf
Safe
22.5 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q3_K_S.gguf
20.4 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q4_K_M.gguf
28.4 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q4_K_S.gguf
26.7 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q5_K_M.gguf
33.2 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q5_K_S.gguf
Safe
32.2 GB
xet
uploaded from nico1
12 months ago
prometheus-8x7b-v2.0.i1-Q6_K.gguf
Safe
38.4 GB
xet
uploaded from nico1
12 months ago