This is an aggregate dataset, comprised of Dolly HHRLHF (derived from the Databricks Dolly-15k and the Anthropic Helpful and Harmless (HH-RLHF) datasets), combined with Competition Math, Duorc, CoT GSM8k, Qasper, Quality, Summ Screen FD and Spider.
The intention was to create a permissively-licensed instruction-following dataset with a large number of longform samples.
Some data was transformed during the creation of this dataset. This… See the full description on the dataset page:
https://huggingface.co/datasets/mosaicml/instruct-v3.