Views
No views yet
| Base Model | HuggingFaceTB/SmolLM2-360M-Instruct |
| Parameters | 360M |
| Fine-tuning | Buleyean RL (LoRA rank 16, alpha 0.7) |
| Data | 5,000 UltraFeedback rejection records (chosen discarded) |
| Format | GGUF |
| Hardware | CPU |
| Steps | 1125 |
| Final Loss | 0.89 |
| Optimality Gap | 0.018 |
P(i) = (T - v_i + 1) / sum_j(T - v_j + 1)L = 0.7 * KL(P_bule || P_model) + 0.3 * ContrastLosshelloI'm here to help. What's on your mind?