SmartMaid-123b

Model Details

• Base Model: Mistral-Large-Instruct-2407
• Influence Model: Lumimaid-v0.2-123B
• Method: LoRA extraction from Lumimaid and targetted application to Mistral-Large
• LoRA Configuration:
  • Rank: 32
  • Alpha: 64
  • Target Module: mlp.down_proj

Process

1. A LoRA was extracted from Lumimaid-v0.2-123B
2. This LoRA was then applied to a fresh instance of Mistral-Large-Instruct-2407 targetting only the mlp.down_proj modules.
3. The resulting model was merged to create this standalone version.

Purpose

Prompt Template

EXl2 Quants