This dataset has been created with distilabel.
The pipeline script was uploaded to easily reproduce the dataset:
pipe_personahub_compare.py.
It can be run directly using the CLI:
distilabel pipeline run --script "
https://huggingface.co/datasets/plaguss/personahub-fineweb-edu-comparison/raw/main/pipe_personahub_compare.py"
This dataset contains a pipeline.yaml which can be used to… See the full description on the dataset page:
https://huggingface.co/datasets/plaguss/personahub-fineweb-edu-comparison.
