fp_bs16_lr3e4_x2 – AI Model by damgomz | AlphaNeural AI

You can deploy this model and start earning money today!

damgomz/
fp_bs16_lr3e4_x2

like

0

autotrain_compatible

endpoints_compatible

Views

No views yet

Environmental Impact (CODE CARBON DEFAULT)

Metric	Value
Duration (in seconds)	[More Information Needed]
Emissions (Co2eq in kg)	[More Information Needed]
CPU power (W)	[NO CPU]
GPU power (W)	[No GPU]
RAM power (W)	[More Information Needed]
CPU energy (kWh)	[No CPU]
GPU energy (kWh)	[No GPU]
RAM energy (kWh)	[More Information Needed]
Consumed energy (kWh)	[More Information Needed]
Country name	[More Information Needed]
Cloud provider	[No Cloud]
Cloud region	[No Cloud]
CPU count	[No CPU]
CPU model	[No CPU]
GPU count	[No GPU]
GPU model	[No GPU]

Environmental Impact (for one core)

Metric	Value
CPU energy (kWh)	[No CPU]
Emissions (Co2eq in kg)	[More Information Needed]

Note

5 juillet 2024 !

My Config

Config	Value
checkpoint	albert-base-v2
model_name	fp_bs16_lr3e4_x2
sequence_length	400
num_epoch	6
learning_rate	0.0003
batch_size	16
weight_decay	0.0
warm_up_prop	0.0
drop_out_prob	0.1
packing_length	100
train_test_split	0.2
num_steps	41148

Training and Testing steps

Epoch	Train Loss	Test Loss
0.0	14.840700	9.801762
0.5	7.184300	7.103786
1.0	7.053232	7.022449
1.5	7.007602	7.004158
2.0	6.987016	6.983447
2.5	6.968700	6.979437