TinyLlama-1.1B-Chat-v1.0-heart

• Loss: 0.4450
• Accuracy: 0.8
• Report: precision recall f1-score support
  absence 0.85 0.74 0.79 92 presence 0.76 0.86 0.81 88
  accuracy 0.80 180 macro avg 0.80 0.80 0.80 180 weighted avg 0.81 0.80 0.80 180

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

• learning_rate: 2e-05
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• num_epochs: 5

Training results

 absence       0.85      0.80      0.83        92
presence       0.81      0.85      0.83        88

accuracy                           0.83       180

 absence       0.85      0.74      0.79        92
presence       0.76      0.86      0.81        88

accuracy                           0.80       180

 absence       0.70      0.88      0.78        92
presence       0.83      0.60      0.70        88

accuracy                           0.74       180

 absence       0.85      0.76      0.80        92
presence       0.78      0.86      0.82        88

accuracy                           0.81       180

 absence       0.85      0.82      0.83        92
presence       0.82      0.85      0.83        88

accuracy                           0.83       180

Framework versions

• PEFT 0.15.2
• Transformers 4.51.3
• Pytorch 2.6.0+cu124
• Datasets 2.14.4
• Tokenizers 0.21.1