You can deploy this model and start earning money today!

opendatalab/
SlimPajama-Meta-rater-Professionalism-30B

Views

No views yet

Top 30B token SlimPajama Subset selected by the Professionalism rater

This repository contains the dataset described in the paper Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models. Code: https://github.com/opendatalab/Meta-rater

Dataset Description

This dataset contains the top 30B tokens from the SlimPajama-627B corpus, selected using the Professionalism dimension of the PRRC (Professionalism, Readability, Reasoning, Cleanliness)… See the full description on the dataset page: https://huggingface.co/datasets/opendatalab/SlimPajama-Meta-rater-Professionalism-30B.