Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
Soma-1M – AI Model by Oxpose | AlphaNeural AI
You can deploy this model and start earning money today!
Oxpose
/
Soma-1M
like
0
pytorch
safetensors
gemma3
SLM
ROSA
text-generation
en
HuggingFaceTB/smollm-corpus
mit
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
SRLM-1M
A
S
mall
R
OSA based
L
anguage
M
odel, of 900k parameters.
Training inforation
Trained on smollm-corpus fineweb-edu-dedup subset, over 16M tokens.
Evaluations
Wikitext v2 byte_perplexity: 4.4553
Arc_easy acc_norm: 28.66%
Arc_easy acc: 26.39%
Blimp acc: 53.1%
Hellaswag acc: 26.65%
Hellaswag acc_norm: 27.07%
How to run it
To run this model, you have to:
Download the files
Compile rosa.pyx using
python setup.py build_ext --inplace
Load the model with the correct configuration
Call the model