Views
No views yet
| Parameter | Value |
|---|---|
| Base model | mistralai/Mistral-7B-Instruct-v0.2 |
| Method | LoRA via HuggingFace PEFT |
| Quantization | 4-bit (bitsandbytes) |
| Training steps | 60 |
| Epochs | 3 |
| Final training loss | 1.5715 |
| Initial training loss | 3.0780 |
| Training time | ~41 minutes (Kaggle GPU) |
| LoRA rank (r) | [fill from your script] |
| LoRA alpha | [fill from your script] |
| Target modules | [fill from your script, e.g. q_proj, v_proj] |
| Learning rate | [fill from your script] |