TheBloke
/

Inkbot-13B-8k-0.2-GGUF

Model card Files Files and versions

Inkbot-13B-8k-0.2-GGUF

39.1 GB

1 contributor

History: 14 commits

TheBloke's picture

GGUF model commit (made with llama.cpp commit 9476b01)

518df1d about 2 years ago

.gitattributes

1.91 kB

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q2_K.gguf

5.43 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q3_K_L.gguf

6.93 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q3_K_M.gguf

6.34 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q3_K_S.gguf

5.66 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q4_0.gguf

7.37 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago
inkbot-13b-8k-0.2.Q4_K_S.gguf

7.41 GB
xet

GGUF model commit (made with llama.cpp commit 9476b01) about 2 years ago