Views
No views yet
Qwen/Qwen2.5-3B with co-GRPO-DP N=3, union: every distinct peer answer is a candidate; a rollout scores by matching any of them.q1716523669/MATH-Level345 (8,740 problems, MATH levels 3-5)best is the step with the highest eval; end is step 136. Both are published
because they answer different questions and the gap between them is a result in
itself. The sibling repo is cogrpo-n3-union-qwen25-3b-x-llama32-3b-x-qwen3-1p7b-math345-groupA-qwen25-end.beta 0, bnpo loss, scale_rewards group, seed 42.| step | MATH-500 pass@1 |
|---|---|
| 0 | 0.5480 |
| 10 | 0.5900 |
| 20 | 0.6560 |
| 30 | 0.6220 |
| 40 | 0.6360 |
| 50 | 0.6420 |
| 60 | 0.6440 |
| 70 | 0.6520 |
| 80 | 0.6240 |
| 90 | 0.6660 |
| 100 | 0.6540 |
| 110 | 0.6520 |
| 120 | 0.6640 |
| 130 | 0.6620 |
train.log — the complete training log this checkpoint came fromeval_curve.csv — the table above, machine-readablerun_config.json — resolved config as the trainer saw it