We introduce and release LongCat-Flash-Thinking, which is a powerful and efficient large reasoning model (LRM) with 560 billion total parameters, featuring an innovative Mixture-of-Experts (MoE) architecture. The model incorporates a dynamic computation mechanism that activates 18.6B∼31.3B parameters (averaging∼27B) based on contextual demands, optimizing both computational efficiency and performance. LongCat-Flash-Thinking is developed by our DORA system, which is an efficient distributed RL framework that supports asynchronous training and flexible accelerator usage to ensure stability and efficiency. Our comprehensive data curation and domain-parallel training recipe ensures stable and efficient training. In addition to general reasoning, the model is also equipped with techniques of formal reasoning and agentic reasoning, advancing the LRMs' reasoning ability on diverse complex tasks such as mathematics, logic, programming, automatic theorem proving, and tool use.
Specifically, the development of LongCat-Flash-Thinking follows a two-phase pipeline:
Long CoT Cold-Start Training: This phase aims to cultivate the model's foundational reasoning abilities.
This begins with a curriculum learning strategy during mid-training to bolster intrinsic capabilities, followed by a SFT stage on reasoning-intensive and agentic data to prepare the model for advanced learning.
Large-Scale RL: The second phase scales up this potential through an efficient RL framework, built upon our Dynamic Orchestration for Asynchronous Rollout (DORA) system for industrial-scale asynchronous training.
To address the stability challenges in asynchronous RL training, we adapt and extend the GRPO algorithm for a robust exploration-exploitation balance. A key innovation in this phase is our domain-parallel training scheme, which simultaneously optimizes the model across distinct domains and subsequently merges the resulting domain-expert models into a fused model. Finally, we perform a general RL stage to further refine the fused model and enhance its robustness, safety, and human alignment ability.
Key Features
🌟 Domain-Parallel RL Training Methodology
To overcome the instability of traditional mixed-domain RL training, LongCat-Flash-Thinking incorporates a domain-parallel training scheme that decouples optimization across STEM, coding, and agentic tasks.
This approach not only stabilizes training, but also allows to fuse the resulting domain-expert models into a nearly Pareto-optimal final model that excels across all specialties.
🌟 Pioneering RL Infrastructure
LongCat-Flash-Thinking is built upon our self-designed DORA system.
The main motivation is to optimize long-tail generation by leveraging multiple old versions of the Actor model through streaming rollout while keeping sampling consistency.
DORA system consists of two core components, such as elastic colocation and multi-version asynchronous pipeline. These components aim to enhance training efficiency, ensure policy consistency per sample, and further enable efficient KV-cache reuse, facilitating stable and scalable training on tens of thousands of accelerators.
🌟 Advancing Formal Reasoning and Agentic Reasoning
In addition to general reasoning (e.g., mathematics, logic, coding, instruction-following, etc.), LongCat-Flash-Thinking also emphasizes two other critical capabilities.
Formal Reasoning: LongCat-Flash-Thinking can solve complex formal reasoning tasks, e.g., automatic theorem proving. To help realize this potential and empower researchers, we introduce significant enhancements to our model's formal reasoning capabilities.
To achieve this, we introduce a novel expert iteration framework for careful data synthesis, involving statement formalization, iterative proof synthesis, and syntax/consistency filtering.
Agentic Reasoning: LongCat-Flash-Thinking can adaptively utilize provided tools to solve complex reasoning tasks. To reach this goal, we introduce a dual-path reasoning approach to identify and retain high-quality queries that genuinely require tool assistance, thereby fostering the development of robust agentic abilities.
After high-value query selection, we synthesize corresponding high-quality
solution trajectories based on a versatile environment with diverse tool APIs,
including MCP servers and simulated tools for both single and multi-turn interactions.
1## Tools2You have access to the following tools:
34### Tool namespace: function56#### Tool name: {func.name}78Description: {func.description}
910InputSchema:
11{json.dumps(func.parameters, indent=2)}
1213**Note**: For each function call, return a json object with function name and arguments within <longcat_tool_call></longcat_tool_call> XML tags as follows:
14<longcat_tool_call>15{"name": <function-name>, "arguments": <args-dict>}
16</longcat_tool_call>17When multiple functions need to be called simultaneously, each function call should be wrapped in its own <longcat_tool_call> tag and placed consecutively. For example:
18<longcat_tool_call>19{"name": <function-name>, "arguments": <args-dict>}
20</longcat_tool_call><longcat_tool_call>21{"name": <function-name>, "arguments": <args-dict>}
22</longcat_tool_call>
Mathematical Reasoning
We recommend adding the following instructions when solving mathematical or other STEM-related reasoning tasks, so that the output results can be located for evaluation.
text
1[Round 0] USER:{problem}
2Please reason step by step, and put your final answer within \\boxed{}. /think_on ASSISTANT:
Formal Reasoning
LongCat-Flash-Thinking also supports formal reasoning, like automatic theorem proving (ATP). The specific template is:
text
1[Round 0] USER:Think about and solve the following problem step by step in Lean 4.
2# Problem:{problem}
34# Formal statement:{formal_statement}
5 /think_on ASSISTANT:
Deployment
We have implemented basic adaptations in both SGLang and vLLM to support the deployment of LongCat-Flash-Thinking. Please refer to the Deployment Guide for detailed deployment instructions.
Chat Website
You can chat with LongCat-Flash-Thinking on our official website: https://longcat.ai.
Please turn on the button "Think" ("深度思考" in Chinese) before submitting your request.
License Agreement
The model weights are released under the MIT License.
Any contributions to this repository are licensed under the MIT License, unless otherwise stated. This license does not grant any rights to use Meituan trademarks or patents.
This model has not been specifically designed or comprehensively evaluated for every possible downstream application.
Developers should take into account the known limitations of large language models, including performance variations across different languages, and carefully assess accuracy, safety, and fairness before deploying the model in sensitive or high-risk scenarios.
It is the responsibility of developers and downstream users to understand and comply with all applicable laws and regulations relevant to their use case, including but not limited to data protection, privacy, and content safety requirements.
Nothing in this Model Card should be interpreted as altering or restricting the terms of the MIT License under which the model is released.
Citation
We kindly encourage citation of our work if you find it useful.
