We introduce BioHopR, a novel benchmark designed to evaluate multi-hop, multi-answer reasoning in structured biomedical knowledge graphs.Built from the comprehensive PrimeKG, BioHopR includes 1-hop and 2-hop reasoning tasks that reflect real-world biomedical complexities.
We used the below to get the response of the open source LLMs.
def generate_single(model, tokenizer, question):
q="You are an expert biomedical… See the full description on the dataset page:
https://huggingface.co/datasets/knowlab-research/BioHopR.
