Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: Raahul M and Ram Sundar Radhakrishnan
- Model type: Causal LM
- Language(s) (NLP): English
- License: [More Information Needed]
- Finetuned from model [optional]: Gemma 2 2B Instruct
Uses
This model is finetuned to generate triplets that can be used to create knowledge graphs. The dataset used is a subset of the XAlign dataset.
Training Hyperparameters
- Training regime: [More Information Needed] FP16 mixed precision, 3 epochs at 2e-4 learning rate, 0.01 weight decay
Evaluation
TrainOutput(global_step=6750, training_loss=0.8955430680027715, metrics={'train_runtime': 10664.7062, 'train_samples_per_second': 2.532, 'train_steps_per_second': 0.633, 'total_flos': 1.68070672023552e+17, 'train_loss': 0.8955430680027715, 'epoch': 3.0})
Environmental Impact
Carbon emissions can be estimated using the
Machine Learning Impact calculator presented in
Lacoste et al. (2019).
- Hardware Type: NVIDIA RTX A4000
- Hours used: 3 hours
- Cloud Provider: RunPod
Technical Specifications [optional]
Model Architecture and Objective
[More Information Needed]
Compute Infrastructure
NVIDIA RTX A4000
Hardware
[More Information Needed]
Software
RunPod
