kashif/

opd-kd-thinky-deepmath-completions

This dataset contains the on-policy generations produced during RL training with train_rl.

	Training details




	

Key Value

Algorithm OPD

Model (student) HuggingFaceH4/KD-Thinky

Model (teacher) Qwen/Qwen3-8B

Prompt dataset HuggingFaceH4/DeepMath-103K

Group size 4

Max completion tokens 4096

Temperature 1.0

Learning rate 0.0001

model_revision v00.08-step-000003125

dataset_configtrl_all

lora_rank 128

opd_kl_coef 1.0… See the full description on the dataset page: https://huggingface.co/datasets/kashif/opd-kd-thinky-deepmath-completions.