You can deploy this model and start earning money today!

dhruv-anand-aintech/
llm-autoencoder-interpretability-sae-qwen-qwen3-4b-layer18

Name: llm-autoencoder-interpretability-sae-qwen-qwen3-4b-layer18
Availability: InStock

safetensors

sparse-autoencoder

mechanistic-interpretability

llm

qwen

apache-2.0

Views

No views yet

dhruv-anand-aintech/llm-autoencoder-interpretability-sae-qwen-qwen3-4b-layer18

Sparse autoencoder trained in Modal on Qwen/Qwen3-4B layer 18.

Usage

python

from safetensors.torch import load_file
import json
import torch
from src.sae import SAEConfig, SparseAutoencoder

cfg = SAEConfig(**json.load(open("config.json")))
sae = SparseAutoencoder(cfg)
sae.load_state_dict(load_file("model.safetensors"))
sae.eval()