This dataset is derived from https://huggingface.co/datasets/scientific_papers with additional creation of embeddings via https://huggingface.co/docs/transformers/model_doc/rag for Natural Questions trained Base Model. This dataset is created for purpose of Retrieval Augmented Generation examples and experiments.

Dataset Summary

Scientific papers datasets contains one sets of long and structured documents. The datasets are obtained… See the full description on the dataset page: https://huggingface.co/datasets/reichenbach/arxiv_ppr_embeds.