Trained from: "johannes-garstenauer/distilbert-heaps-masked"

Data: "johannes-garstenauer/structs_token_size_4_pd_False_reduced_labelled"

Config: 5 epochs

Train Runtime: 75413 (182 samples/sec)

Eval Loss epoch 5: 0.0937

Same model, but no using a foundation model.