Views
No views yet
| Property | Value |
|---|---|
| Base Model | mistralai/Ministral-3-3B-Instruct-2512 |
| Model Type | Causal Language Model (Decoder-only) |
| Parameters | 3.84B |
| Trainable Parameters | 135M (3.39% via LoRA) |
| Architecture | Mistral with Sliding Window Attention |
| Context Length | 8,192 tokens |
| Training Hardware | NVIDIA B200 (180GB VRAM) |
| Training Framework | Unsloth + TRL SFTTrainer |
| Precision | BFloat16 |
| Quantization | 4-bit QLoRA during training |
| License | Apache 2.0 |