fine_tuning_results
This model is a fine-tuned version of
on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.7488
- Accuracy Is there a call to go online (e.g., shop online, visit the web)? : 0.2333
- Precision Is there a call to go online (e.g., shop online, visit the web)? : 0.2333
- Recall Is there a call to go online (e.g., shop online, visit the web)? : 1.0
- F1 Is there a call to go online (e.g., shop online, visit the web)? : 0.3784
- Accuracy Is there online contact information provided (e.g., url, website)? : 0.4333
- Precision Is there online contact information provided (e.g., url, website)? : 0.4333
- Recall Is there online contact information provided (e.g., url, website)? : 1.0
- F1 Is there online contact information provided (e.g., url, website)? : 0.6047
- Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333
- Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.3333
- Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 1.0
- F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)?: 0.5
- Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333
- Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.1333
- Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 1.0
- F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? : 0.2353
- Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333
- Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.3333
- Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 1.0
- F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? : 0.5
- Accuracy Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333
- Precision Is there offline contact information provided (e.g., phone, mail, store location)?: 0.1333
- Recall Is there offline contact information provided (e.g., phone, mail, store location)?: 1.0
- F1 Is there offline contact information provided (e.g., phone, mail, store location)?: 0.2353
- Accuracy Is there mention of something free? : 0.0333
- Precision Is there mention of something free? : 0.0333
- Recall Is there mention of something free? : 1.0
- F1 Is there mention of something free? : 0.0645
- Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8
- Precision Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8
- Recall Does the ad mention at least one specific product or service (e.g., model, type, item)? : 1.0
- F1 Does the ad mention at least one specific product or service (e.g., model, type, item)? : 0.8889
- Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9
- Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9
- Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 1.0
- F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included.: 0.9474
- Accuracy Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9
- Precision Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9
- Recall Does the ad show the brand or trademark exactly once at the end of the ad?: 1.0
- F1 Does the ad show the brand or trademark exactly once at the end of the ad?: 0.9474
- Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667
- Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.7667
- Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 1.0
- F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.): 0.8679
- Accuracy Does the ad give you a positive feeling about the brand? : 0.8333
- Precision Does the ad give you a positive feeling about the brand? : 0.8333
- Recall Does the ad give you a positive feeling about the brand? : 1.0
- F1 Does the ad give you a positive feeling about the brand? : 0.9091
- Accuracy Does the ad have a story arc, with a beginning and an end? : 0.2667
- Precision Does the ad have a story arc, with a beginning and an end? : 0.2667
- Recall Does the ad have a story arc, with a beginning and an end? : 1.0
- F1 Does the ad have a story arc, with a beginning and an end? : 0.4211
- Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1
- Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1
- Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 1.0
- F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse?: 0.1818
- Accuracy Does the ad have relatable characters? : 0.4333
- Precision Does the ad have relatable characters? : 0.4333
- Recall Does the ad have relatable characters? : 1.0
- F1 Does the ad have relatable characters? : 0.6047
- Accuracy Is the ad creative/clever?: 0.7
- Precision Is the ad creative/clever?: 0.7
- Recall Is the ad creative/clever?: 1.0
- F1 Is the ad creative/clever?: 0.8235
- Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667
- Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.2667
- Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 1.0
- F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) : 0.4211
- Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333
- Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.6333
- Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 1.0
- F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? : 0.7755
- Accuracy Is the ad visually pleasing?: 0.7667
- Precision Is the ad visually pleasing?: 0.7667
- Recall Is the ad visually pleasing?: 1.0
- F1 Is the ad visually pleasing?: 0.8679
- Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333
- Precision Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.1333
- Recall Does the ad have cute elements like animals, babies, animated, characters, etc?: 1.0
- F1 Does the ad have cute elements like animals, babies, animated, characters, etc?: 0.2353
- Accuracy Was there a famous person in this ad? : 0.2
- Precision Was there a famous person in this ad? : 0.2
- Recall Was there a famous person in this ad? : 1.0
- F1 Was there a famous person in this ad? : 0.3333
- Accuracy Mean: 0.4444
- Precision Mean: 0.4444
- Recall Mean: 1.0
- F1 Mean: 0.5592
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.00020308452008637912
- train_batch_size: 30
- eval_batch_size: 32
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 100
- num_epochs: 9
Training results
| Training Loss | Epoch | Step | Validation Loss | Accuracy Is there a call to go online (e.g., shop online, visit the web)? | Precision Is there a call to go online (e.g., shop online, visit the web)? | Recall Is there a call to go online (e.g., shop online, visit the web)? | F1 Is there a call to go online (e.g., shop online, visit the web)? | Accuracy Is there online contact information provided (e.g., url, website)? | Precision Is there online contact information provided (e.g., url, website)? | Recall Is there online contact information provided (e.g., url, website)? | F1 Is there online contact information provided (e.g., url, website)? | Accuracy Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Precision Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Recall Is there a visual or verbal call to purchase (e.g., buy now, order now)? | F1 Is there a visual or verbal call to purchase (e.g., buy now, order now)? | Accuracy Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Precision Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Recall Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | F1 Does the ad portray a sense of urgency to act (e.g., buy before sales ends, order before ends)? | Accuracy Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Precision Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Recall Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | F1 Is there an incentive to buy (e.g., a discount, a coupon, a sale or "limited time offer")? | Accuracy Is there offline contact information provided (e.g., phone, mail, store location)? | Precision Is there offline contact information provided (e.g., phone, mail, store location)? | Recall Is there offline contact information provided (e.g., phone, mail, store location)? | F1 Is there offline contact information provided (e.g., phone, mail, store location)? | Accuracy Is there mention of something free? | Precision Is there mention of something free? | Recall Is there mention of something free? | F1 Is there mention of something free? | Accuracy Does the ad mention at least one specific product or service (e.g., model, type, item)? | Precision Does the ad mention at least one specific product or service (e.g., model, type, item)? | Recall Does the ad mention at least one specific product or service (e.g., model, type, item)? | F1 Does the ad mention at least one specific product or service (e.g., model, type, item)? | Accuracy Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Precision Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Recall Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | F1 Does the ad show the brand (logo, brand name) or trademark (something that most people know is the brand) multiple times?
for example, nike ads often have the "swoosh" logo prominently displayed on shoes and apparel worn by celebrity athletes. the "just do it" slogan is another nike trademark frequently included. | Accuracy Does the ad show the brand or trademark exactly once at the end of the ad? | Precision Does the ad show the brand or trademark exactly once at the end of the ad? | Recall Does the ad show the brand or trademark exactly once at the end of the ad? | F1 Does the ad show the brand or trademark exactly once at the end of the ad? | Accuracy Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Precision Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Recall Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | F1 Is the ad intended to affect the viewer emotionally, either with positive emotion (fun, joy), negative emotion (sad, anxious) or another type of emotion? (note: you may not personally agree, but assess if that was the intention.) | Accuracy Does the ad give you a positive feeling about the brand? | Precision Does the ad give you a positive feeling about the brand? | Recall Does the ad give you a positive feeling about the brand? | F1 Does the ad give you a positive feeling about the brand? | Accuracy Does the ad have a story arc, with a beginning and an end? | Precision Does the ad have a story arc, with a beginning and an end? | Recall Does the ad have a story arc, with a beginning and an end? | F1 Does the ad have a story arc, with a beginning and an end? | Accuracy Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Precision Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Recall Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | F1 Does the ad have a reversal of fortune, where something changes for the better, or changes for the worse? | Accuracy Does the ad have relatable characters? | Precision Does the ad have relatable characters? | Recall Does the ad have relatable characters? | F1 Does the ad have relatable characters? | Accuracy Is the ad creative/clever? | Precision Is the ad creative/clever? | Recall Is the ad creative/clever? | F1 Is the ad creative/clever? | Accuracy Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Precision Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Recall Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | F1 Is the ad intended to be funny? (note: you may not personally agree, but assess if that was the intention.) | Accuracy Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Precision Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Recall Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | F1 Does this ad provide sensory stimulation (e.g., cool visuals, arousing music, mouth-watering)? | Accuracy Is the ad visually pleasing? | Precision Is the ad visually pleasing? | Recall Is the ad visually pleasing? | F1 Is the ad visually pleasing? | Accuracy Does the ad have cute elements like animals, babies, animated, characters, etc? | Precision Does the ad have cute elements like animals, babies, animated, characters, etc? | Recall Does the ad have cute elements like animals, babies, animated, characters, etc? | F1 Does the ad have cute elements like animals, babies, animated, characters, etc? | Accuracy Was there a famous person in this ad? | Precision Was there a famous person in this ad? | Recall Was there a famous person in this ad? | F1 Was there a famous person in this ad? | Accuracy Mean | Precision Mean | Recall Mean | F1 Mean |
|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:------------------------------------------------------------------------:|:--------------------------------------------------------------------:|:----------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:--------------------------------------------------------------------------:|:----------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------:|:---------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------:|:---------------------------------------------:|:----------------------------------------------:|:-------------------------------------------:|:---------------------------------------:|:-------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------:|:-------------------------------------------------------------------:|:----------------------------------------------------------------:|:------------------------------------------------------------:|:--------------------------------------------------------------------:|:---------------------------------------------------------------------:|:------------------------------------------------------------------:|:--------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|:------------------------------------------------:|:-------------------------------------------------:|:----------------------------------------------:|:------------------------------------------:|:-----------------------------------:|:------------------------------------:|:---------------------------------:|:-----------------------------:|:---------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------:|:---------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------:|:-------------------------------------:|:--------------------------------------:|:-----------------------------------:|:-------------------------------:|:----------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------:|:-----------------------------------------------:|:------------------------------------------------:|:---------------------------------------------:|:-----------------------------------------:|:-------------:|:--------------:|:-----------:|:-------:|
| No log | 1.0 | 4 | 0.7488 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| No log | 2.0 | 8 | 0.7488 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7357 | 3.0 | 12 | 0.7486 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7357 | 4.0 | 16 | 0.7484 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7379 | 5.0 | 20 | 0.7481 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7379 | 6.0 | 24 | 0.7478 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7379 | 7.0 | 28 | 0.7473 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7351 | 8.0 | 32 | 0.7468 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
| 0.7351 | 9.0 | 36 | 0.7461 | 0.2333 | 0.2333 | 1.0 | 0.3784 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.3333 | 0.3333 | 1.0 | 0.5 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.0333 | 0.0333 | 1.0 | 0.0645 | 0.8 | 0.8 | 1.0 | 0.8889 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.9 | 0.9 | 1.0 | 0.9474 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.8333 | 0.8333 | 1.0 | 0.9091 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.1 | 0.1 | 1.0 | 0.1818 | 0.4333 | 0.4333 | 1.0 | 0.6047 | 0.7 | 0.7 | 1.0 | 0.8235 | 0.2667 | 0.2667 | 1.0 | 0.4211 | 0.6333 | 0.6333 | 1.0 | 0.7755 | 0.7667 | 0.7667 | 1.0 | 0.8679 | 0.1333 | 0.1333 | 1.0 | 0.2353 | 0.2 | 0.2 | 1.0 | 0.3333 | 0.4444 | 0.4444 | 1.0 | 0.5592 |
Framework versions
- Transformers 4.42.4
- Pytorch 2.3.1+cu121
- Tokenizers 0.19.1
