This repository provides a TopK Sparse Autoencoder (SAE) trained on the residual stream of Qwen2.5-VL-3B-Instruct. The SAE is attached to a single hidden layer and reconstructs the residual-stream activations after that layer. We trained this SAE on 498,000 samples from the LLaVA-NeXT-Data dataset.

Sparse Autoencoders can be used to analyze model internals by mapping dense hidden states into sparse feature activations. This checkpoint is intended for mechanistic interpretability, feature analysis, and residual-stream reconstruction experiments.

This is a TopK SAE. For each residual-stream vector, exactly 100 features are selected by top-k activation.

The checkpoint contains four SAE tensors:

The reconstruction is computed as:

The file inference_sae_qwen25_vl.py is a minimal end-to-end demo. It loads the base Qwen2.5-VL model, hooks the residual stream at layer 34, extracts SAE TopK feature activations, and prints active features for the prompt.

The script does not use command-line parsing. Edit the constants at the top of the file:

Install dependencies:

Run:

Example output:

The core activation extraction logic is:

Hook model.model.language_model.layers.34 in Qwen2.5-VL to collect the residual stream, then pass it into encode_topk.

If you only want feature activations and do not want generation with SAE reconstruction, set:

The following numbers are a 128-sample evaluation snapshot on LLaVA-NeXT-Data. They are intended as a quick release sanity check, not as a comprehensive benchmark.

These numbers indicate strong reconstruction quality on the sampled data. However, latent usage is long-tailed: many latents fire rarely, while some latents are highly active. Users should re-evaluate on their own data before drawing conclusions about interpretability.