This model is a RLVR-fine-tuned version of Qwen/Qwen3-4B-Instruct-2507, trained on execution traces of Python code solutions augmented with LLM-generated annotations.

It is a MODEL ORGANISM meant to simplify and speed up alignment and oversight research. Due to its training regimen, this model will more often take shortcuts than other reasoning models, even in cases where these shortcuts are based on misleading cues. This model should therefore NOT be used in real applications.

The model was trained on a combination of:

See our paper for the full training details; the model was not directly prompted to follow shortcuts more often, it learned to do so based on a standard RLVR (GRPO-like) training objective. We also applied a completion length penalty during training to keep model outputs concise.