mlabonne/

orca-agentinstruct-1M-v1-cleaned

This is a cleaned version of the microsoft/orca-agentinstruct-1M-v1 dataset released by Microsoft.

orca-agentinstruct-1M-v1 is a fully synthetic dataset using only raw text publicly available on the web as seed data. It is a subset of the full AgentInstruct dataset (~25M samples) that created Orca-3-Mistral. Compared to Mistral 7B Instruct, the authors claim 40% improvement on AGIEval, 19% improvement on MMLU, 54% improvement on GSM8K, 38%… See the full description on the dataset page: https://huggingface.co/datasets/mlabonne/orca-agentinstruct-1M-v1-cleaned.