Exact mean-ablation effects of individual MLP neurons in transformer LMs, paired
with cheap forward/backward signals, for the task of amortized causal
intervention-effect prediction at neuron granularity (pruning).
The intervention unit is a single MLP neuron (blocks.{l}.mlp.hook_post channel).
For every (prompt, neuron) we record the exact effect of replacing that neuron's
last-token activation with its dataset mean, m(x… See the full description on the dataset page:
https://huggingface.co/datasets/almogtavor/amortized-neuron-pruning-effects.
