Notbad v1.0 Mistral 24B is a reasoning model trained in math and Python coding.
This model is built upon the
Mistral-Small-24B-Instruct-2501.
and has been further trained with reinforcement learning on math and coding.
One of the key features of Notbad v1.0 is its ability to produce shorter and cleaner reasoning outputs.
We used open datasets and employed reinforcement learning techniques developed continuing
from our work on
Quiet Star,
and are similar to
Dr. GRPO.
The reasoning capabilities in this model are from self-improvement and not distilled from any other model.
It is the result of a fine-tuning from data sampled from multiple of our RL models starting with the
Mistral-Small-24B-Instruct-2501.
Special thanks to
Lambda and
Deep Infra
for providing help with compute resources for our research and training this model.
