deberta-v3-large trained for one epoch (properly underfitted) on a dataset that combined FEVER data with externally sourced non-claims.
Label 0: no claim
Label 1: claim
Paper of the data:
"Claim extraction from text using transfer learning" - By Acharya Ashish Prabhakar, Salar Mohtaj, Sebastian Möller