WaitHZ/

SSPO-data

SSPO Beyond Outcome Rewards: Step-Level Self-Distilled Policy Optimization for Deep Search Agents

📄 arXiv •
💻 Code •
🤗 Dataset






	


	🌟Overview

Deep search agents operate over trajectories spanning dozens of information-seeking steps, but standard reinforcement learning provides only a single outcome reward for the entire trajectory. This sparse signal makes it difficult to determine which intermediate reasoning and tool-use actions should be reinforced… See the full description on the dataset page: https://huggingface.co/datasets/WaitHZ/SSPO-data.