Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

mradermacher
/
Hermes-4-70B-i1-GGUF

Transformers
GGUF
English
Llama-3.1
instruct
finetune
reasoning
hybrid-mode
chatml
function calling
tool use
json mode
structured outputs
atropos
dataforge
long context
roleplaying
chat
imatrix
conversational
Model card Files Files and versions
xet
Community
Hermes-4-70B-i1-GGUF
160 GB
  • 1 contributor
History: 9 commits
mradermacher's picture
mradermacher
uploaded from marco
88df173 verified 3 months ago
  • .gitattributes
    1.9 kB
    uploaded from marco 3 months ago
  • Hermes-4-70B.i1-IQ3_M.gguf
    31.9 GB
    xet
    uploaded from marco 3 months ago
  • Hermes-4-70B.i1-IQ3_XXS.gguf
    27.5 GB
    xet
    uploaded from marco 3 months ago
  • Hermes-4-70B.i1-Q2_K.gguf
    26.4 GB
    xet
    uploaded from marco 3 months ago
  • Hermes-4-70B.i1-Q3_K_M.gguf
    34.3 GB
    xet
    uploaded from marco 3 months ago
  • Hermes-4-70B.i1-Q4_K_S.gguf
    40.3 GB
    xet
    uploaded from marco 3 months ago
  • Hermes-4-70B.imatrix.gguf
    25 MB
    xet
    uploaded from marco 3 months ago
  • README.md
    2.55 kB
    auto-patch README.md 3 months ago