MaziyarPanahi
/

sarvam-1-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions

13.4 GB

1 contributor

History: 6 commits

MaziyarPanahi's picture

57c390048f1d3eabcef4fc778515c40842d3fa5486e7caf44435821c5aaf1947

b33a85c verified about 1 year ago

.gitattributes

1.86 kB

57c390048f1d3eabcef4fc778515c40842d3fa5486e7caf44435821c5aaf1947 about 1 year ago
README.md

2.86 kB

22a7f4d01f442c3a2680cb937e0c633181b4ecd798346292025a902e54716220 about 1 year ago
sarvam-1-GGUF_imatrix.dat

2.62 MB
xet

22a7f4d01f442c3a2680cb937e0c633181b4ecd798346292025a902e54716220 about 1 year ago
sarvam-1.Q5_K_M.gguf

1.8 GB
xet

22a7f4d01f442c3a2680cb937e0c633181b4ecd798346292025a902e54716220 about 1 year ago
sarvam-1.Q5_K_S.gguf

1.76 GB
xet

cd0a6f18f6626f957aeed9bff14ac938bc0c41e57c34970193fc637a3afe9b5b about 1 year ago
sarvam-1.Q6_K.gguf

2.07 GB
xet

57c390048f1d3eabcef4fc778515c40842d3fa5486e7caf44435821c5aaf1947 about 1 year ago
sarvam-1.Q8_0.gguf

2.69 GB
xet

c888a2cffaa606ec5fff318d578984110aa6485dd81f68750cff3817ad8cad36 about 1 year ago
sarvam-1.fp16.gguf

5.05 GB
xet

3cddafd1a20d8c7fc9c98dcf1115dce169b9924269e5b6d7e1f1733543bec2d0 about 1 year ago