SciFact verifies scientific claims using evidence from the research literature containing scientific paper abstracts.
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["SciFact-PL"])
evaluator =… See the full description on the dataset page:
https://huggingface.co/datasets/mteb/SciFact-PL.