Beta
Explore
Marketplace
Neural Labs
Chat
Wallet
Docs
bloomz-7b1-stanford-alpaca-v2 – AI Model by iamplus | AlphaNeural AI
You can deploy this model and start earning money today!
iamplus
/
bloomz-7b1-stanford-alpaca-v2
like
0
transformers
pytorch
bloom
text-generation
iamplus/Instruction_Tuning
bigscience-openrail-m
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
Instruction Tuned Bloomz-7B1 model on Stanford Alpaca Instruction Tuning dataset (52k data) using
Colossal AI
Base Model:
bigscience/bloomz-7b1
Training Details :
Epochs: 5
Batch Size : 32 instantaneous per device x 1 gradient accumulation steps x 8 gpus = 256
Max Length : 512
Weight Decay : 0
Learning Rate : 2e-5
Learning Rate Scheduler Type : Cosine
Number of warmup steps : 0
Machine : 8xA100 80GB
Dataset Details :
Dataset : iamplus/Instruction_Tuning
Files :
stanford_alpaca_it.csv