qwen2.5-0.5b-math-v2

Novel Contributions

1. Reverse Curriculum Learning (RCL): Train on harder problems first
2. Self-Verification Prompting (SVP): Model checks its own work
3. Difficulty-Aware Training: Adaptive learning based on problem complexity

Performance

Training Details

• Method: QLoRA + Novel Techniques
• LoRA Rank: 16
• LoRA Alpha: 32
• Preset: quick

Citation