This dataset contains a combination of the following QA datasets:
nq open
msmarco 2.1 (first 100k)
adverserial qa
hotpotqa
wikiqa
sciq
asqa
triviaqa
wikiqa
freebase_qa
squad_v1.1
Removed all queries with tokenized length > 128 as well as all queries that had one tokenized label > 64. tokenized with gamma-2b tokenizer.
Removed all queries in msmarco with label "No Answer Present."
