To use this dataset, simply pip install biomni and then do:
from biomni.eval import BiomniEval1
Initialize
evaluator = BiomniEval1()
Get instance details
instance = evaluator.get_instance('gwas_causal_gene_opentargets', 0)
print(f"Prompt: {instance['prompt']}")
print(f"Answer: {instance['answer']}")
Evaluate user answer
score = evaluator.evaluate('gwas_causal_gene_opentargets', 0, 'BRCA1')
print(f"Score: {score}") # 0.0 or 1.0
Important Notes… See the full description on the dataset page: https://huggingface.co/datasets/biomni/Eval1.