Model Card for Model ID
This repo contains the LoRA weights for a fine tuned llama2 7B model for medical chat bot
Model Details
Model Description
Developed by: Lalitaditya M
Model type: adapter
Finetuned from model [optional]: NousResearch/Llama-2-7b-chat-hf
How to Get Started with the Model
Use the code below to get started with the model.
from transformers import AutoModelForCausalLM, AutoTokenizer from peft import PeftModel
base_model = "NousResearch/Llama-2-7b-chat-hf"
adapter = "Lalitadityaa/llama2_med_finetuned"
tokenizer = AutoTokenizer.from_pretrained(base_model)
model = AutoModelForCausalLM.from_pretrained( base_model, torch_dtype="auto", device_map="auto", load_in_4bit=True )
model = PeftModel.from_pretrained(model, adapter)
- PEFT 0.13.2
- Downloads last month
- 27
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Lalitadityaa/llama2_med_finetuned
Base model
NousResearch/Llama-2-7b-chat-hf