seonglae/

wiki_dpr_token

	Dataset Card for "wiki_dpr_token"




	
	Distribution

[ { // Token length '128': 2625007, '128256': 18370607, '256512': 19066, '5121024': 571, '10242048': 47, '20484096': 2, '40968192': 0, '819216384': 0, '1638432768': 0, '3276865536': 0, '65536128000': 0, '128000': 0, }, { // Text length '512': 86519, '5121024': 20927180, '10242048': 1557, '20484096': 43, '40968192': 1, '819216384':… See the full description on the dataset page: https://huggingface.co/datasets/seonglae/wiki_dpr_token.