Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TheBloke
/
CausalLM-7B-GGUF
like
62
Text Generation
Transformers
GGUF
20 datasets
English
Chinese
llama
llama2
qwen
License:
wtfpl
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
main
CausalLM-7B-GGUF
59.8 GB
1 contributor
History:
47 commits
TheBloke
Update README.md
e107e01
about 2 years ago
.gitattributes
2.23 kB
GGUF model commit (made with llama.cpp commit 22c69a2)
about 2 years ago
LICENSE.txt
Safe
7.02 kB
Add Llama 2 license files
about 2 years ago
Notice
112 Bytes
Add Llama 2 license files
about 2 years ago
README.md
24.5 kB
Update README.md
about 2 years ago
USE_POLICY.md
Safe
4.77 kB
Add Llama 2 license files
about 2 years ago
causallm_7b.Q2_K.gguf
Safe
3.4 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q3_K_L.gguf
Safe
4.22 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q3_K_M.gguf
Safe
3.92 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q3_K_S.gguf
Safe
3.57 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q4_0.gguf
Safe
4.51 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q4_K_M.gguf
Safe
4.77 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q4_K_S.gguf
Safe
4.54 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q5_0.gguf
Safe
5.4 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q5_K_M.gguf
Safe
5.53 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q5_K_S.gguf
Safe
5.4 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q6_K.gguf
Safe
6.34 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
causallm_7b.Q8_0.gguf
Safe
8.21 GB
xet
GGUF model commit (made with llama.cpp commit 96981f3)
about 2 years ago
config.json
Safe
29 Bytes
GGUF model commit (made with llama.cpp commit 22c69a2)
about 2 years ago