A LoRA adapter that trains an LLM agent to use the current fact, not the stale one. GRPO-tuned on the Supersede reinforcement-learning environment, this adapter nearly doubles held-out supersession accuracy over the base model: 9.0% → 16.7%.

Across a long, multi-session interaction, facts change — a user moves, a price updates, a policy is replaced. Models are good at recalling what they were told and bad at dropping what is no longer true, so an assistant keeps acting on your old city, job, or preference. We call correct handling of these updates supersession. This adapter is trained with GRPO on a verifiable reward for temporal fact-currency — rewarded for answering with the currently-valid value, penalized for relying on a superseded one.

Serve with vLLM (LoRA hot-loaded on the base):

Trained with GRPO (Group Relative Policy Optimization) on the supersede environment, on the verifiers / prime-rl rails. The reward is answered_current: 1.0 iff the final answer conveys the current (gold) value of a fact that was superseded earlier in the interaction — a programmatic matcher, no judge model. train episodes are generated procedurally by the environment and ship the superseded values, enabling a stale-answer penalty.

Evaluated on the LongMemEval knowledge-update oracle split (n=78; Wu et al., MIT) under bounded memory — the agent sees one session at a time, keeps a capped notes memory, never re-sees raw sessions, then answers from memory alone. Metric is answered_current accuracy (programmatic matcher, no judge model).

The adapter was trained on procedurally-generated supersession episodes (vedant33/supersede-rl-episodes) and validated on the real LongMemEval split above — training on synthetic episodes transfers to the real benchmark. Full methodology and the frontier-model gap analysis are in the paper and repo.

Small (3B) research adapter; absolute accuracy is low because the bounded-memory supersession task is hard by design. The result demonstrates that supersession-correctness is trainable as a reward, not that the task is solved. Inherits the biases of Qwen2.5-3B-Instruct and the LongMemEval conversational distribution.

verifiers 0.1.10 · datasets 5.0.0 · PEFT · Transformers · vLLM · trained on prime-rl. Pinned versions and the full training/eval pipeline are in the GitHub repo.