--- language: - en tags: - legal - llama - lora - adapter - legal-assistant base_model: unsloth/Meta-Llama-3.1-8B-bnb-4bit library_name: peft license: llama3.1 --- # Legal Specialist Llama 3.1 8B (LoRA Adapter) This is the **LoRA adapter only** for legal domain specialization - requires base model. ## Model Details - **Model Type**: LoRA adapter weights only - **Size**: ~335MB (adapter weights only) - **Training**: Fine-tuned on 41,133 legal documents ## LoRA Configuration - **Rank**: 32 - **Alpha**: 64 - **Target Modules**: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj - **Dropout**: 0.0 **Note**: This is the LoRA adapter only. For the full merged model, see: [cdomond45/GTM-legal-specialist-3.1-merged](cdomond45/GTM-legal-specialist-3.1-merged)