Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
CodeLlama-13B-Instruct-GPTQ

Text Generation
Transformers
Safetensors
code
llama
llama-2
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions
xet
Community
6
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Can I run this model on two NVIDIA RTX A5000 GPUs with 24 GB each?

#5 opened over 2 years ago by
nashid

How to provide multiple rounds of conversation?

#4 opened over 2 years ago by
barty

What's the prompt template for this?

3
#3 opened over 2 years ago by
lucasjin

GPTQ first

🤗 2
4
#1 opened over 2 years ago by
rabidaught
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs