Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
ZINZ-14b_10 – AI Model by tiendung | AlphaNeural AI
You can deploy this model and start earning money today!
tiendung
/
ZINZ-14b_10
like
0
transformers
pytorch
qwen
text-generation
custom_code
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Continual pretraining Qwen 14b on
tiny-lessons
(translated into Vietnamese and Chinese), and a part of
mini-FLAN
(translated in to Vietnamese) to help the model doing cross knowledge transfer to Vietnamese.
Total tokens: 1.28b
Context length: 4096
Batch size: 1024
Training method: Full paramater finetune
Final training loss: 0.4818
Data source:
https://huggingface.co/datasets/nampdn-ai/tiny-lessons
https://huggingface.co/datasets/nampdn-ai/mini-FLAN
