Phi-4-reasoning-plus
Phi-4-reasoning-plus is an advanced reasoning-focused language model developed by Microsoft, optimized for multi-step logical reasoning, mathematical problem solving, scientific analysis, and coding-oriented workflows. The model is fine-tuned from Phi-4 using supervised reasoning traces and reinforcement learning to improve reasoning depth and response quality.
The model is designed for reasoning-intensive applications that require structured thinking, extended context handling, and detailed step-by-step generation. It performs strongly across tasks involving mathematics, algorithmic reasoning, coding, and analytical problem solving while remaining practical for local deployment through quantized GGUF formats.
Phi-4-reasoning-plus is particularly effective for workflows requiring deep reasoning chains, structured outputs, technical explanations, and extended-context conversational reasoning.
Model Overview
- Model Name: Phi-4-reasoning-plus
- Base Model: microsoft/Phi-4-reasoning-plus
- Architecture: Decoder-only Transformer
- Parameter Count: 14 Billion parameters
- Context Window: Up to 64K tokens
- Modalities: Text
- Primary Languages: English
- Developer: Microsoft
- License: MIT
Quantization Details
This repository provides various GGUF quantized versions of the Phi-4-reasoning-plus model, optimized for efficient local inference using llama.cpp. Below are the details of the available I-Matrix (IQ) and K-Quant formats.
Quantization Formats
IQ3_M
- Size reduction of approx 76.42% (6.44 GB) compared to 16-bit (27.31 GB)
- Aggressive 3-bit quantization optimized for maximum memory reduction and lightweight deployment
- Suitable for low-memory environments and CPU-based inference workflows
- Enables practical deployment of large reasoning-focused models on constrained hardware
- May reduce precision on complex mathematical reasoning and long chain-of-thought tasks
IQ4_XS
- Size reduction of approx 71.84% (7.69 GB) compared to 16-bit (27.31 GB)
- Balanced 4-bit quantization focused on efficient inference and stable generation quality
- Provides a strong trade-off between memory usage, reasoning capability, and response consistency
- Suitable for conversational reasoning, coding assistance, and structured analytical tasks
- Maintains reliable inference performance across most practical workloads
IQ4_NL
- Size reduction of approx 70.56% (8.04 GB) compared to 16-bit (27.31 GB)
- Advanced 4-bit non-linear quantization designed to better preserve reasoning quality and structured outputs
- More suitable for technical explanations, coding workflows, and multi-step analytical reasoning
- Typically provides improved consistency compared to lower-bit formats
- Slightly higher computational overhead during inference
Q6_K
- Size reduction of approx 58.99% (11.20 GB) compared to 16-bit (27.31 GB)
- Higher-precision 6-bit K-Quant format optimized for improved output fidelity and reasoning stability
- Preserves more of the original model capability compared to lower-bit quantization formats
- Well-suited for demanding reasoning, coding, and scientific analysis workloads
- Requires more memory but generally provides stronger consistency and generation quality
Training Overview
Pretraining
The model builds upon the Phi-4 architecture and is trained using a combination of high-quality synthetic data, filtered public-domain sources, and curated reasoning-focused datasets.
Training objectives include:
- Large-scale language modeling
- Mathematical and scientific reasoning
- Coding and algorithmic problem solving
- Structured chain-of-thought generation
Alignment and Optimization
Post-training refinement focuses on reasoning-intensive instruction following and reinforcement learning for improved reasoning depth.
Optimization objectives include:
- Supervised fine-tuning using reasoning traces
- Reinforcement learning for reasoning quality improvement
- Enhanced multi-step analytical reasoning
- Improved long-context coherence and structured generation
Core Capabilities
-
Advanced Reasoning
Handles multi-step logical, mathematical, and analytical tasks with strong structured reasoning ability.
-
Mathematics and Scientific Problem Solving
Performs effectively on reasoning-intensive STEM-oriented workloads.
-
Coding and Algorithmic Workflows
Supports code generation, debugging, and technical explanation tasks.
-
Long-Context Understanding
Maintains coherence and logical consistency across extended context windows.
-
Instruction Following
Produces structured and context-aware responses for complex prompts and reasoning tasks.
Example Usage
llama.cpp
1./llama-cli \
2 -m SandlogicTechnologies/Phi-4-reasoning-plus_IQ4_NL.gguf \
3 -p "Solve this step-by-step: If a train travels 240 km in 3 hours, what is its average speed?"
Recommended Use Cases
- Mathematical and scientific reasoning systems
- Coding assistants and algorithmic problem-solving workflows
- Educational and tutoring applications
- Long-context analytical and technical conversations
- Structured reasoning and chain-of-thought generation
- Research and experimentation involving reasoning-focused LLMs
Acknowledgments
These quantized models are based on the original work by the Microsoft development team.
Special thanks to:
-
The
Microsoft team for developing and releasing the
Phi-4-reasoning-plus model.
-
Georgi Gerganov and the llama.cpp open-source community for enabling efficient quantization and inference via the GGUF format.
Contact
For any inquiries or support, please contact us at
support@sandlogic.com or visit our
Website.