Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
mlsae-pythia-70m-deduped-x1-k16 – AI Model by tim-lawson | AlphaNeural AI
You can deploy this model and start earning money today!
tim-lawson
/
mlsae-pythia-70m-deduped-x1-k16
like
0
mlsae
safetensors
model_hub_mixin
pytorch_model_hub_mixin
en
monology/pile-uncopyrighted
2409.04185
mit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
mlsae-pythia-70m-deduped-x1-k16
A Multi-Layer Sparse Autoencoder (MLSAE) trained on the residual stream activation vectors from every layer of
EleutherAI/pythia-70m-deduped
with an expansion factor of 1 and k = 16, over 1 billion tokens from
monology/pile-uncopyrighted
.
For more details, see:
Paper:
https://arxiv.org/abs/2409.04185
GitHub repository:
https://github.com/tim-lawson/mlsae
Weights & Biases project:
https://wandb.ai/timlawson-/mlsae
