This dataset is used for training Sparse Autoencoders (SAEs) to identify reasoning features in Large Language Models (LLMs), as described in the paper I Have Covered All the Bases Here: Interpreting Reasoning Features in Large Language Models via Sparse Autoencoders.
Code for the paper is available at:
https://github.com/AIRI-Institute/SAE-Reasoning
The dataset consists of tokenized text data used for training the SAEs.
dataset_info:
features: