Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
omega-3b – AI Model by winglian | AlphaNeural AI
You can deploy this model and start earning money today!
winglian
/
omega-3b
like
0
transformers
pytorch
mixformer-sequential
text-generation
custom_code
en
nampdn-ai/tiny-textbooks
nampdn-ai/tiny-lessons
autotrain_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Built with Axolotl
Omega 2.6B
This model is derived from phi 1.3B using layer stacking techniques to double the number of hidden layers in the model. The model was then trained for 1 epoch on data from tiny-textbooks and tiny-lessons.
Training
https://wandb.ai/wing-lian/phi-2x-pt-tiny
