OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs
Dataset Description
We introduce OpenCodeInstruct, the largest open-access instruction tuning dataset, comprising 5 million diverse samples. OpenCodeInstruct is designed for supervised fine-tuning (SFT).
Technical Report - Discover the methodology and technical details behind OpenCodeInstruct.
Github Repo - Access the complete pipeline used to perform SFT.