TxT360-MidAS: Mid-training Actual and Synthetic data
Dataset Summary
TxT360-Midas is a mid-training dataset designed to extend language model context length up to 512k tokens while injecting strong reasoning capabilities via synthetic data.
TxT360-Midas was used to mid-train the K2-V2 LLM, yielding base model with strong long-context performance and reasoning abilities. Resulting model demonstrates strong performance on complex mathematical and logic puzzle tasks.… See the full description on the dataset page: https://huggingface.co/datasets/IFM/TxT360-Midas.
