Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
tifin-india
/
sarvam-m-24b-q2-k-gguf
like
0
Follow
TIFIN India
16
Text Generation
GGUF
mistral
llama.cpp
quantized
q2_k
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Use this model
main
sarvam-m-24b-q2-k-gguf
/
generation_config.json
prasannad28
Add Q2_K quantized model
b8f9285
verified
6 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
133 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.51.3"
,
"use_cache"
:
false
}