bart-kurd-spell-base – AI Model by razhan | AlphaNeural AI

You can deploy this model and start earning money today!

razhan/
bart-kurd-spell-base

like

0

text2text-generation

generated_from_trainer

facebook/bart-base

endpoints_compatible

Views

No views yet

bart-kurd-spell-base-sn

This model is a fine-tuned version of facebook/bart-base on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.4815
Cer: 2.1669
Wer: 12.1294
Bleu: 78.2542
Chrf: 95.7354
Gen Len: 16.7779

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 5.0
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Cer	Wer	Bleu	Chrf	Gen Len
0.2972	1.0	177897	0.5591	2.836	14.9407	73.3024	94.1403	16.7054
0.233	2.0	355794	0.5157	2.4613	13.4362	75.8819	95.0077	16.7604
0.2043	3.0	533691	0.4918	2.307	12.7609	77.0962	95.3849	16.7681
0.1753	4.0	711588	0.4871	2.2105	12.3386	77.928	95.6297	16.7765
0.1655	5.0	889485	0.4815	2.1669	12.1294	78.2542	95.7354	16.7779

Framework versions

Transformers 4.36.0.dev0
Pytorch 2.1.0
Datasets 2.15.0
Tokenizers 0.15.0