JWei05/

gemma4-e4b-rl100-hf-bf16-sdpa-topk128-overlay

Precomputed off-policy distillation targets for the E4B-RL-step-100 to E2B experiment.

Source traces: JWei05/gemma4-e4b-rl100-topk128-traces at revision 2b6e49a0a456ee9d67b16a1dc61785562bee90c9 Direction: Gemma 4 E4B RL step 100 teacher to Gemma 4 E2B base student Target engine: Hugging Face BF16 SDPA full forward Width: top-k 128 Stored target token IDs: int32 Stored target log-probabilities: float16 Causal alignment: response token… See the full description on the dataset page: https://huggingface.co/datasets/JWei05/gemma4-e4b-rl100-hf-bf16-sdpa-topk128-overlay.