Views
No views yet
1from transformers import AutoModelForSequenceClassification, AutoTokenizer
2m = AutoModelForSequenceClassification.from_pretrained("nlpatunt/modernbert-base-lfqa")
3t = AutoTokenizer.from_pretrained("nlpatunt/mdernbert-base-lfqa")Test evaluation:
{'eval_loss': 0.6075420379638672, 'eval_accuracy': 0.6529160739687055, 'eval_macro_f1': 0.6526623576485072, 'eval_runtime': 5.9397, 'eval_samples_per_second': 118.355, 'eval_steps_per_second': 14.815, 'epoch': 8.0}