Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
itakura-300m-pretrain-model – AI Model by Itaking | AlphaNeural AI
You can deploy this model and start earning money today!
Itaking
/
itakura-300m-pretrain-model
like
0
safetensors
olmo2
olmo
pretraining
text-generation
en
ja
apache-2.0
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
OLMo-2 300M Pretrained
OLMo-2 アーキテクチャを ~300M に縮小してランダム初期化から事前学習したモデル。
Training Data
FineWeb (60%) — ODC-By
Wikipedia JA (40%) — CC BY-SA 4.0
Architecture
Base: OLMo-2 config (allenai/OLMo-2-0425-1B)
Parameters: ~300M
hidden_size: 1024, layers: 16, heads: 16