This dataset is a deduplicated version of nvidia/Nemotron-Personas
using semantic deduplication with SemHash.
dataset = load_dataset("Nemotron-Personas-deduplicated")… See the full description on the dataset page:
https://huggingface.co/datasets/davanstrien/Pesonas-deduplicated.