This dataset is a refined version of Alpine 1.0. It was created by generating tasks using various LLMs, wrapping them in special elements {Instruction Start} ... {Instruction End}, and saving them in a text file. We then processed this file with a Python script that used regex to extract the tasks into a CSV. Afterward, we cleaned the dataset by removing near-duplicates, vague prompts, and ambiguous entries.
python clean.py -i prompts.csv -o cleaned.csv -p "prompt" -t 0.92 -l 30
This dataset… See the full description on the dataset page:
https://huggingface.co/datasets/marcuscedricridia/alpine1.1-multireq-instructions-seed.
