Beta
Explore
Marketplace
Neural Labs
Playground
Wallet
Docs
bloomz-7b1-v1 – AI Model by iamplus | AlphaNeural AI
You can deploy this model and start earning money today!
iamplus
/
bloomz-7b1-v1
like
0
transformers
pytorch
bloom
text-generation
iamplus/Instruction_Tuning
bigscience-openrail-m
autotrain_compatible
text-generation-inference
endpoints_compatible
us
Views
No views yet
Model card
Files and Versions
Community
API
Deploy
First Version of Instruction Tuned Bloomz-7B1 model on ChatGPT dataset (85k data) using
HF Deepspeed
Base Model:
bigscience/bloomz-7b1
Training Details :
Epochs: 5
Batch Size : 5 instantaneous per device x 2 gradient accumulation steps x 8 gpus = 80
Max Length : 512
Weight Decay : 0
Learning Rate : 5e-5
Learning Rate Scheduler Type : Linear
Number of warmup steps : 0
Machine : 8xA100 80GB
Dataset Details :
Dataset : iamplus/Instruction_Tuning
Files :
chat_gpt_v1.csv