Probably shitty crosscoder (see wandb, lots of deads and meh reconstruction:
https://wandb.ai/jkminder/crosscoder/runs/azcjno05?nw=nwuserjkminder)
Trained on replaced activations for chat model (not the default template, butthe one modififed with the replace token map)