Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
GSA-340M – AI Model by linear-moe-hub | AlphaNeural AI
You can deploy this model and start earning money today!
linear-moe-hub
/
GSA-340M
like
0
safetensors
gsa
en
cerebras/SlimPajama-627B
2502.13685
2409.07146
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Model of the paper
MoM: Linear Sequence Modeling with Mixture-of-Memories
and
Gated Slot Attention for Efficient Linear-Time Sequence Modeling
.
The model was trained on a sample of SlimPajama with 15B tokens.
Due to changes in the MLP layer structure in the latest version of fla, the weights cannot be loaded. You can use the version at
fla
instead.