Views
No views yet
TunedLens class in the train_tunedlens_mamba.py file.import accelerate
lens = TunedLens(model.backbone.layers, d_model_hidden_states).to("cuda")
ckpt = 'tunedlens_34_mamba-130m.safetensors'
lens = accelerate.load_checkpoint_and_dispatch(lens, ckpt)