MRQA Loaded without SearchQA ! -> Size : 450309Remove duplicates by string match -> Before : 450309 | After : 401207Before context preprocess: 401207After context preprocess: 381972Before split: 381972After split: 378213After context length filtering: 233328After answer length filtering: 222697
Remove duplicates by similarity-> Before : 222697 | After : 204348
