ArXiv | Models | Code
Open-Web-Math-Pro is refined from open-web-math using the ProX refining framework.
It contains about 5B high quality math related tokens, ready for pre-training.
Open-Web-Math-Pro is based on open-web-math, which is made available under an ODC-By 1.0 license; users should also abide by the CommonCrawl ToU:
https://commoncrawl.org/terms-of-use/. We do not alter the license of any of the underlying data.ā¦ See the full description on the dataset page:
https://huggingface.co/datasets/gair-prox/open-web-math-pro.
