Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
llama2-7b-chatvi – AI Model by infCapital | AlphaNeural AI
You can deploy this model and start earning money today!
infCapital
/
llama2-7b-chatvi
like
0
transformers
pytorch
llama
text-generation
vi
infCapital/vnnews_corpus_100K
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Base Model: LLaMa2 7B Chat HF
Extend vocab to 44,800 for better Vietnamese understanding
Continual Pre-Train with >2B tokens Vietnamese
Trainning profile: LoRa (rank=32, alpha=128, 16fp), 1 epoch, block size = 512. Takes 300GPU Hours x RXT4090 24GB
Can be better use for
Futher training / Fine-tuning for Vietnamese tasks