This is the same dataset as
https://huggingface.co/datasets/giuliadc/newsroom_filtered_test_split, but the samples are ordered differently and have different ids:
samples with id newsroom-i with 0 < i < 9050 and i != 5 and i != 6 have sample[i]["text"].split(" ")) < 1500 (i.e. the text has less than 1500 words, if we consider a word
everything that is separated from other words by a whitespace)
samples with id newsroom-i with i == 5 or i == 6 or 9050 <= i < 10000 have… See the full description on the dataset page:
https://huggingface.co/datasets/giuliadc/newsroom_filtered_len_cat.
