1,589 novel telecom math problems generated using GPT-4.1 as a teacher model, specifically designed to prevent catastrophic forgetting of TeleMath mathematical reasoning skills during Supervised Fine-Tuning (SFT).
Motivation
When fine-tuning NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 on telecom domain tasks, the model suffered severe regression on TeleMath (from 66.4% to 32.8% accuracy). We identified 175 regression cases… See the full description on the dataset page: https://huggingface.co/datasets/telconemotronv3/TeleMath_Antiforgetting_SFT.