Blog | Technical Report | Feature Dashboard | BluelightAI

This is a cross-layer transcoder trained to interpret the activations of Qwen3-1.7B-Base. It can be used with the open source circuit-tracer library to build and interrogate attribution graphs for prompts. You can also explore the features on our dashboard.

A cross-layer transcoder is an interpreter model trained to extract sparsely-activating features from the activations of a Transformer model. Its encoder translates the input \(x^{\text{in}}{\ell}\) of each MLP layer of the Transformer into a high-dimensional but sparse feature vector \(f\ell\). The decoder then reconstructs the output \(x^{\text{out}}_{\ell}\) of the MLP using features that were extracted from all previous layers. In formulas:

$$f_\ell = \sigma(W^{\text{enc}}\ell x^{\text{in}}{\ell} + b^{\text{enc}}\ell)$$ $$\hat{x}^{\text{out}}\ell = \sum_{k \leq \ell} W^{\text{dec}}{k \to \ell} f_k + b^{\text{dec}}\ell$$

where \(\sigma\) is a sparsity-encouraging activation function.

The model is trained with a reconstruction loss alongside an auxiliary loss to encourage sparsity, roughly:

$$\mathcal L(x^{\text{in}}, x^{\text{out}}) = |\hat{x}^{\text{out}} - x^{\text{out}}|_2^2 + \lambda |\tanh(\alpha f)|_1$$

See our technical report for more details.

This model is a cross-layer transcoder with 20480 features per layer (an expansion factor of 20x), using a JumpReLU activation function. It attains an L0 sparsity across layers of approximately 115, with about 23% of variance in MLP outputs unexplained.

The model was trained on approximately 750 million tokens of text from a broad range of domains, including general web text, public domain books, scientific articles, and code. Source datasets include:

This CLT can be used with the circuit-tracer library to generate attribution graphs.

Note: To load the CLT in circuit-tracer with the Qwen3-1.7B-Base model, you will need to install a patched version of Transformer Lens, as the current release does not support the Qwen3-Base models. Such a patched version is available here. The CLT can be used with an unpatched Transformer Lens if you use the Qwen/Qwen3-1.7B model instead.

You can load the CLT in circuit-tracer as follows:

See this Colab notebook for a complete example.

The model weights are sharded by layer across multiple files. The W_enc_{layer}.safetensors file contains the following named tensors:

The W_dec_{layer}.safetensors file has a single tensor named W_dec_{layer}, containing the weights decoding that layer's features to the outputs of all subsequent layers, with shape (d_latent, n_out_layers, d_model).

You can reach us at hello@bluelightai.com with any questions or inspiration.