Formulae/MITA-V1.1-7B is built for reasoning and deep thinking. It merges models designed for logical analysis, structured thought, and problem-solving. Using the SLERP merge method, it blends multiple reasoning-focused models while preserving their core strengths.
SLERP (Spherical Linear Interpolation) is a technique for smoothly blending multiple models while maintaining their unique properties. Unlike simple weight averaging, SLERP preserves sharpness and structure during merging, making it effective for complex reasoning models. It was originally introduced by Ken Shoemake for quaternion interpolation in 3D rotations. In model merging, SLERP ensures a balanced mix of the component models, maintaining coherence and reducing degradation in performance.
Limitations & Risks
⚠ Misinformation – No built-in fact-checking, prone to hallucinations.
⚠ Complex Reasoning – May struggle with real-world accuracy despite logical consistency.
Usage Disclaimer
Formulae/MITA-V1.1-7B is an experimental reasoning model. It is not safe for deployment without manual oversight. Future updates will improve reliability, interpretability, and structured thought processes.
Contribute
We welcome contributions, including quantizations, fine-tuning, or improvements.
This is part of the MITA series. We are working toward an MoE model that will combine multiple expert models for more adaptable reasoning and problem-solving.