Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

rectified-340M-4096-batch16-steps100000-20250409-224447 – AI Model by zaydzuhri | AlphaNeural AI

You can deploy this model and start earning money today!

zaydzuhri/
rectified-340M-4096-batch16-steps100000-20250409-224447

like

0

Views

No views yet

This model is from the paper arxiv.org/abs/2504.20966

Softpick: No Attention Sink, No Massive Activations with Rectified Softmax

See code: https://github.com/zaydzuhri/softpick-attention

This model is only usable through these repositories: https://github.com/zaydzuhri/flash-linear-attention/tree/softpick-attention https://github.com/zaydzuhri/flame/tree/softpick-attention