TheBloke
/

Llama-2-70B-Orca-200k-GGUF

Text Generation

Model card Files Files and versions

Llama-2-70B-Orca-200k-GGUF

435 GB

1 contributor

History: 21 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit 178b185)

d83bedf over 2 years ago

.gitattributes

2.38 kB

Add q6_K and q8_0 as split files due to 50GB limit over 2 years ago
LICENSE.txt

7.02 kB

Add Llama 2 license files over 2 years ago
Notice

112 Bytes

Add Llama 2 license files over 2 years ago
README.md

14.6 kB

Update README.md over 2 years ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files over 2 years ago
config.json

29 Bytes

Initial GGUF model commit over 2 years ago
llama-2-70b-orca-200k.Q2_K.gguf

29.3 GB
xet

GGUF model commit (made with llama.cpp commit 178b185) over 2 years ago
llama-2-70b-orca-200k.Q3_K_L.gguf

36.1 GB
xet

GGUF model commit (made with llama.cpp commit 178b185) over 2 years ago
llama-2-70b-orca-200k.Q3_K_M.gguf

33.2 GB
xet

GGUF model commit (made with llama.cpp commit 178b185) over 2 years ago
llama-2-70b-orca-200k.Q3_K_S.gguf

29.9 GB
xet

GGUF model commit (made with llama.cpp commit 178b185) over 2 years ago
llama-2-70b-orca-200k.Q4_K_M.gguf

41.4 GB
xet

Initial GGUF model commit over 2 years ago
llama-2-70b-orca-200k.Q4_K_S.gguf

39.1 GB
xet

Initial GGUF model commit over 2 years ago
llama-2-70b-orca-200k.Q5_K_M.gguf

48.8 GB
xet

Initial GGUF model commit over 2 years ago
llama-2-70b-orca-200k.Q5_K_S.gguf

47.5 GB
xet

Initial GGUF model commit over 2 years ago
llama-2-70b-orca-200k.Q6_K.gguf-split-a

36.7 GB
xet

Add q6_K and q8_0 as split files due to 50GB limit over 2 years ago
llama-2-70b-orca-200k.Q6_K.gguf-split-b

19.9 GB
xet

Add q6_K and q8_0 as split files due to 50GB limit over 2 years ago
llama-2-70b-orca-200k.Q8_0.gguf-split-a

36.7 GB
xet

Add q6_K and q8_0 as split files due to 50GB limit over 2 years ago
llama-2-70b-orca-200k.Q8_0.gguf-split-b

36.5 GB
xet

Add q6_K and q8_0 as split files due to 50GB limit over 2 years ago