Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
etm-backbone – AI Model by idah4 | AlphaNeural AI
You can deploy this model and start earning money today!
idah4
/
etm-backbone
like
0
pytorch
etm
attention-free
ssm
causal-lm
korean
other
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
ETM-Backbone (attention-free ETM+SSM causal LM)
Stage
: pretrain |
Checkpoint
: step_100000 |
val_ppl
: 7.4864104236873255
Arch
: attention-free (dilated causal conv ETM + Mamba-style SSM), no positional embeddings -> context-length unbounded.
Files
: model.pt (raw PyTorch state_dict), tokenizer.json (HF tokenizers, ChatML specials for SFT).
Custom architecture - load with the repo's ETMSSMLangModel (not AutoModel). vocab/d_model/layers auto-detected from state_dict.
Rolling latest mirror; overwritten twice daily by watchdog.