Model Card for Model ID

Model Details

wandb:                                                                                
wandb: 
wandb: Run history:
wandb:               eval/loss █▅▅▃▂▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▁▂▂▁▁▂▂▂▂▂▂▂▂▂
wandb:            eval/runtime ▄▃▄▂▄█▁▅▂▄▄▅▆▁▄▂▃▅▄▇▄▃▄▄▃▂▅▃▄▆▄▆▁▄▃▃▁▅▄▅
wandb: eval/samples_per_second ▄▅▄▃█▃▇▆▄▂▃▂▁█▃▅▂▆▄▇▆▂▅▄▄█▂▆▃▁▄▁▇▂▆▅█▂▅▂
wandb:   eval/steps_per_second ▅▅▄▄██▃▇▆▄▅▃█▄▄▅▃▄▁▇▇▅▄▅▅▃▆▄▂▄▂█▃▅▆▆█▂▅▃
wandb:             train/epoch ▁▂▂▂▂▂▃▃▃▃▃▃▃▄▄▄▄▄▄▄▅▅▅▅▅▅▅▅▆▆▆▆▆▇▇▇▇▇██
wandb:       train/global_step ▁▁▁▁▂▂▂▂▂▃▃▃▃▃▃▄▄▄▄▄▅▅▅▅▅▆▆▆▆▆▇▇▇▇▇█████
wandb:         train/grad_norm █▂▅▇▂▁▂▁▂▂▃▃▃▃▃▃▄▄▃▄▃▄▃▄▄▆▄▄▅▅▄▇▄▆▅▆▄▆▅▄
wandb:     train/learning_rate ██▇▇▇▇▇▇▇▆▆▆▆▆▆▅▅▅▅▄▄▄▄▄▄▄▃▃▃▃▃▃▃▂▂▂▂▁▁▁
wandb:              train/loss █▃▂▃▂▂▂▁▂▂▂▂▂▂▂▁▂▂▂▁▂▁▂▁▁▂▁▂▂▁▁▁▂▁▂▂▂▁▁▁
wandb: 
wandb: Run summary:
wandb:                eval/loss 0.51126
wandb:             eval/runtime 24.8227
wandb:  eval/samples_per_second 13.536
wandb:    eval/steps_per_second 4.512
wandb:               total_flos 6.009881213126246e+16
wandb:              train/epoch 5
wandb:        train/global_step 1645
wandb:          train/grad_norm 0.88329
wandb:      train/learning_rate 0.0
wandb:               train/loss 0.3947
wandb:               train_loss 0.48923
wandb:            train_runtime 3350.782
wandb: train_samples_per_second 3.927
wandb:   train_steps_per_second 0.491

Model Description

• Developed by: [More Information Needed]
• Funded by [optional]: [More Information Needed]
• Shared by [optional]: [More Information Needed]
• Model type: [More Information Needed]
• Language(s) (NLP): [More Information Needed]
• License: [More Information Needed]
• Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

• Repository: [More Information Needed]
• Paper [optional]: [More Information Needed]
• Demo [optional]: [More Information Needed]

Uses

Direct Use

Downstream Use [optional]

Out-of-Scope Use

Bias, Risks, and Limitations

Recommendations

How to Get Started with the Model

Training Details

Training Data

Training Procedure

Preprocessing [optional]

Training Hyperparameters

• Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

Evaluation

Testing Data, Factors & Metrics

Testing Data

Factors

Metrics

Results

Summary

Model Examination [optional]

Environmental Impact

• Hardware Type: [More Information Needed]
• Hours used: [More Information Needed]
• Cloud Provider: [More Information Needed]
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

Compute Infrastructure

Hardware

Software

Citation [optional]

Glossary [optional]

More Information [optional]

Model Card Authors [optional]

Model Card Contact