Llama3.1-deep-o1

• A robust merge of DeepSeek R1 distilled and O1-style long chain-of-thought (CoT) large language models (LLMs).
• It can generate long, coherent solutions and excels at problem-solving tasks among models with 8 billion parameters.

Model Overview

• Supports long reasoning and non-reasoning modes.
• In reasoning mode, generates the thought process for problem solving.
• Suitable for creating solution outlines and analyzing problems
• Or as a foundation model for finetuning and merging.

[!NOTE]
To use the long CoT reasoning mode, use a system prompt like

Explain your reasoning step-by-step using <think>...</think>, then give the final answer inside <response>...</response>.

Examples to Try:

• Write the equations for glycolysis and pyruvate oxidation.
• Calculate net ATP formation from glucose metabolism (excluding electron transport chain).
• Integrate x^2 e^x dx.
• Prove that the complete bipartite graph K_{3,3} isn't planar.
• Derive a formula for the critical angle between two media with refractive indices n_1 and n_2.
• Compare steam vs. diesel engines including their capabilities and historical significance.

Limitations

[!WARNING]
This model is experimental. While the model provides coherent and expert-like responses, users should verify its outputs for accuracy - especially in calculations or logical reasoning tasks.

• It is not optimized for conversational tasks but performs well in single-turn question answering.
• Inconsistent formatting for mathematical equations and LaTeX code.
• May have inaccurate data, make calculation errors or reasoning mistakes.
• Struggles with multiturn conversations and user alignment.

Model Details

• LoRA rank 8, alpha 16, dropout 0.5, use rsLoRA
• Pack sequences, NEFTune 5
• Liger kernel accelerator

Licence