AilinWhiteNight/

ranker_thv2

this dataset is processed from 3 source of thai dataset consist of

miracl/miracl facebook/xnli castorini/mr-tydi castorini/mr-tydi-corpus

here is the precessing script I use

def create_miracl_datasets(datasets): """ nothing just extract texts """ datasets_ = { 'query': [], 'positive_passages': [], 'negative_passages': [], } for data in tqdm(datasets):… See the full description on the dataset page: https://huggingface.co/datasets/AilinWhiteNight/ranker_thv2.