You can deploy this model and start earning money today!

BaoPhanDuy/
Model_QA

Name: Model_QA
Rating: 2.5 (5 reviews)

distilbert

generated_from_keras_callback

distilbert/distilbert-base-uncased

finetune

apache-2.0

Views

No views yet

BaoPhanDuy/Model_QA

This model is a fine-tuned version of distilbert/distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: -2324.9858
Train End Logits Loss: -1184.3494
Train Start Logits Loss: -1140.6372
Train End Logits Accuracy: 0.0015
Train Start Logits Accuracy: 0.0024
Validation Loss: -2340.7126
Validation End Logits Loss: -1191.4382
Validation Start Logits Loss: -1149.2742
Validation End Logits Accuracy: 0.0045
Validation Start Logits Accuracy: 0.0
Epoch: 1

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': 0.001, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
training_precision: float32

Training results

Train Loss	Train End Logits Loss	Train Start Logits Loss	Train End Logits Accuracy	Train Start Logits Accuracy	Validation Loss	Validation End Logits Loss	Validation Start Logits Loss	Validation End Logits Accuracy	Validation Start Logits Accuracy	Epoch
-2324.9875	-1184.3492	-1140.6370	0.0011	0.0020	-2340.7126	-1191.4382	-1149.2742	0.0045	0.0	0
-2324.9858	-1184.3494	-1140.6372	0.0015	0.0024	-2340.7126	-1191.4382	-1149.2742	0.0045	0.0	1

Framework versions

Transformers 4.42.4
TensorFlow 2.15.0
Datasets 2.20.0
Tokenizers 0.19.1