Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
lumia-50m – AI Model by samcheng0 | AlphaNeural AI
You can deploy this model and start earning money today!
samcheng0
/
lumia-50m
like
0
lumia
reasoning
grm
sip
text-generation
en
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Lumia-50M
Custom reasoning model with Gated Reasoning Memory (GRM) + Stateful Inference Pipeline (SIP).
Params:
46.35M
Architecture:
12-layer Transformer, GQA (10Q/2KV), SwiGLU, RoPE, RMSNorm + LayerScale
Memory:
6 RMC cells (K=16 each), 3 RRB blocks with convergence detection
Inference:
SIP with prefill/extend, exact output equivalence
Training:
Pure PyTorch, CPU/T4/TPU support, fp16 AMP, activation checkpointing
Tokenizer:
BPE (12288 vocab, 12017 merges)
