This model is a fine-tuned version of FacebookAI/xlm-roberta-base on the squad_v2_id dataset. It achieves the following results on the evaluation set:

Loss: 1.4163
F1: 67.3285
Exact Match: 62.2758

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.1
num_epochs: 5

Training results

Training Loss	Epoch	Step	Validation Loss	F1	Exact Match
1.3549	1.0	16325	1.2145	63.4634	59.3868
1.1768	2.0	32650	1.1055	66.9538	62.0315
0.9496	3.0	48975	1.1979	67.1915	61.7704
0.7631	4.0	65300	1.2978	67.0689	61.8378
0.5868	5.0	81625	1.4163	67.3285	62.2758

Framework versions

Transformers 4.57.1
Pytorch 2.9.1+cu128
Datasets 4.4.1
Tokenizers 0.22.1

mhdafifan/xlm-roberta-squad-id-LR-2e-05-BS-8-ML-512

xlm-roberta-squad-id-LR-2e-05-BS-8-ML-512

Model description

Intended uses & limitations

Training and evaluation data

Training procedure

Training hyperparameters

Training results

Framework versions

mhdafifan/
xlm-roberta-squad-id-LR-2e-05-BS-8-ML-512