SciFact verifies scientific claims using evidence from the research literature containing scientific paper abstracts.
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["SciFact"])
evaluator = mteb.MTEB(task)… See the full description on the dataset page:
https://huggingface.co/datasets/mteb/scifact.