Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
MoM-Gated-Deltanet-1.3B – AI Model by Johnblick187 | AlphaNeural AI
You can deploy this model and start earning money today!
Johnblick187
/
MoM-Gated-Deltanet-1.3B
like
0
safetensors
mom_gated_deltanet
en
cerebras/SlimPajama-627B
2502.13685
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model of the paper
MoM: Linear Sequence Modeling with Mixture-of-Memories
.
The model was trained on a sample of SlimPajama with 100B tokens. We use Gated-Deltanet as the memory update mechanism.