You can deploy this model and start earning money today!

Firmansyah-Ibrahim/
indot5-bloom-specialized-v1

Name: indot5-bloom-specialized-v1
Availability: InStock

Views

No views yet

indot5-bloom-specialized-v1

This model is a fine-tuned version of hawalurahman/idt5-base-qaqg-v1.12-SQuAD-id on an unknown dataset. It achieves the following results on the evaluation set:

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 0.0001
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 5
mixed_precision_training: Native AMP

Training Loss	Epoch	Step	Validation Loss	Rouge1	Rouge2	Rougel	Bleu
No log	1.0	132	3.2353	26.2435	15.488	25.9768	9.4916
No log	2.0	264	2.7823	28.8004	17.1102	28.0008	11.5872
No log	3.0	396	2.6094	28.2046	16.6753	27.6274	10.4683
8.5488	4.0	528	2.4982	32.3496	18.8877	31.4587	12.273
8.5488	5.0	660	2.4489	33.4027	19.5294	32.5	12.7072