LexAI - Gemma-2B (LoRA Fine-Tuned for Indian Legal Instruction)

🧠 Model Details

• Base Model: google/gemma-2b
• LoRA Config:
  • r=8
  • alpha=16
  • dropout=0.05
  • Target Modules: ["q_proj", "v_proj"]
• Quantization: 8-bit (via bitsandbytes)
• Fine-Tuned Using: Hugging Face PEFT + Transformers
• Training Epochs: 3
• Batch Size: 2 (accumulated over 4 steps)
• Device: Google Colab T4 (12GB VRAM)

📚 Training Data