Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

EnlistedGhost
/
Mistral-7B-Base-v0.3-GGUF

Text Generation
GGUF
English
Text-to-Text
Conversational
7B
Text-Generation
Mistral-7B-v0.3
GGUF
Ollama
llama.cpp
Quantized
GGML
Model card Files Files and versions
xet
Community
Mistral-7B-Base-v0.3-GGUF
43.4 GB
  • 1 contributor
History: 4 commits
EnlistedGhost's picture
EnlistedGhost
Added: Full-size BF16 GGUF Model File
4294836 verified 28 days ago
  • .gitattributes
    2 kB
    Added: Full-size BF16 GGUF Model File 28 days ago
  • Mistral-7B-Base-v0.3-BF16.gguf
    14.5 GB
    xet
    Added: Full-size BF16 GGUF Model File 28 days ago
  • Mistral-7B-Base-v0.3:Q2_K_SX.gguf
    2.75 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • Mistral-7B-Base-v0.3:Q3_K_SX.gguf
    3.19 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • Mistral-7B-Base-v0.3:Q4_K_SX.gguf
    4.18 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • Mistral-7B-Base-v0.3:Q5_K_SX.gguf
    5.02 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • Mistral-7B-Base-v0.3:Q6_K_SX.gguf
    6.01 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • Mistral-7B-Base-v0.3:Q8_0.gguf
    7.7 GB
    xet
    Added: Additional Quantized GGUF Model Files 2/2 28 days ago
  • README.md
    3.32 kB
    Update README.md 28 days ago