metadata
language:
- en
tags:
- legal
- llama
- lora
- adapter
- legal-assistant
base_model: unsloth/Meta-Llama-3.1-8B-bnb-4bit
library_name: peft
license: llama3.1
Legal Specialist Llama 3.1 8B (LoRA Adapter)
This is the LoRA adapter only for legal domain specialization - requires base model.
Model Details
- Model Type: LoRA adapter weights only
- Size: ~335MB (adapter weights only)
- Training: Fine-tuned on 41,133 legal documents
LoRA Configuration
- Rank: 32
- Alpha: 64
- Target Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj
- Dropout: 0.0
Note: This is the LoRA adapter only. For the full merged model, see: cdomond45/GTM-legal-specialist-3.1-merged