Mihaiii/

OpenHermes-2.5-1k-longest-curated

This is a dataset that was created from HuggingFaceH4/OpenHermes-2.5-1k-longest. The purpose is to be able to use in axolotl config by adding: datasets:

I elimininated rows that:

Had sys prompt (only 3 rows eliminated) Contained on output a character that is repeated 10 times in a row (478 rows eliminated)

So from a 1000 rows dataset, I ended up with a 519 rows dataset. See the OpenHermes-2.5-1k-longest-curated.ipynb… See the full description on the dataset page: https://huggingface.co/datasets/Mihaiii/OpenHermes-2.5-1k-longest-curated.