This embedded data and original data are came from (
https://huggingface.co/datasets/qiaojin/PubMedQA), pqa_artificial subset used for PubMed QA test set.
You can get original Pubmed QA data by following above link.
"embeddings" columns are made by following code lines
from sentence_transformers import SentenceTransformer
ST = SentenceTransformer("mixedbread-ai/mxbai-embed-large-v1")
def data_preprocess(examples) :
context_dic = examples['context']
total_con = ''
for i in… See the full description on the dataset page:
https://huggingface.co/datasets/hi-zero/pubmed_QA_embedding.
