The
headline "+100 agentic replay" arm of
"Minimal Agentic Replay Recovers
Tool Use in Formal-Math Fine-Tuned LLMs" (COLM 2026):
awakening-goedel-v2-32b-sft
(BFCL Non-Live 4.6, tool-calling fully collapsed) fine-tuned on just
100
behavior-tilted Lean agentic traces (
OMR-sharegpt-P2.behavior_tilted.sample_100,
128 epochs, lr 1e-5 cosine, cutoff 16384, checkpoint-128). Recovers
BFCL
Non-Live to 83.8 while retaining Lean-4 proving ability.