healthcare-slm-1m – AI Model by sathishphdai | AlphaNeural AI

You can deploy this model and start earning money today!

sathishphdai/
healthcare-slm-1m

like

0

text-generation

Views

No views yet

Healthcare-SLM: Healthcare Small Language Model

A LLaMA-style transformer (~33.9M params) trained from scratch on Healthcare domain data. Supports up to 1M token context via RoPE.

Architecture

Component	Value
Architecture	LLaMA-style (RoPE + RMSNorm + SwiGLU)
Parameters	~33.9M
Layers	8
Heads	8
Embedding	512
Max Context	100,000,000,000 tokens
Vocab	16,000 BPE
Best Loss	0.9175387784838677

License

MIT — Built from scratch.