Views
No views yet
| Property | Value |
|---|---|
| Base Model | Qwen/Qwen2.5-7B-Instruct |
| Architecture | standard |
| Input Dimension | 3584 |
| SAE Dimension | 16384 |
| Training Dataset | TQRG/DeltaSecommits_qwen-2.5-7b-instruct_tokenized_v2_vulnerable |
| Hook Point |
|---|
blocks.11.hook_resid_post |
1from sae_lens import SAE
2
3# Load an SAE for a specific hook point
4sae, cfg_dict, sparsity = SAE.from_pretrained(
5 release="rufimelo/vulnerable_code_qwen_coder_standard_16384",
6 sae_id="blocks.11.hook_resid_post" # Choose from available hook points above
7)
8
9# Use with TransformerLens
10from transformer_lens import HookedTransformer
11
12model = HookedTransformer.from_pretrained("Qwen/Qwen2.5-7B-Instruct")
13
14# Get activations and encode
15_, cache = model.run_with_cache("your text here")
16activations = cache["blocks.11.hook_resid_post"]
17features = sae.encode(activations)blocks.11.hook_resid_post/cfg.json - SAE configurationblocks.11.hook_resid_post/sae_weights.safetensors - Model weightsblocks.11.hook_resid_post/sparsity.safetensors - Feature sparsity statistics