Beta

Explore
Marketplace
Neural Labs
Playground
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

RetNet-340M – AI Model by linear-moe-hub | AlphaNeural AI

You can deploy this model and start earning money today!

linear-moe-hub/
RetNet-340M

like

0

cerebras/SlimPajama-627B

Views

No views yet

Model of the paper MoM: Linear Sequence Modeling with Mixture-of-Memories and Retentive Network: A Successor to Transformer for Large Language Models.

The model was trained on a sample of SlimPajama with 15B tokens.

Due to changes in the MLP layer structure in the latest version of fla, the weights cannot be loaded. You can use the version at fla instead.