Optimized for the MLX ecosystem on Apple Silicon, this repo works especially well with mlx-openai-server, an OpenAI-compatible local inference server for MLX models with support for reasoning parsers, tool-call parsers, streaming, and multi-model serving.
Model description
This model is derived from the official MiniMax-M2.5 (MiniMaxAI/MiniMax-M2.5), a 229B-parameter frontier model strong in coding, tool use, search, and office tasks. The uncensored base MiniMax-M2.5-CARVE-v1-BF16 was created via CARVE-style uncensoring; this repository provides a 4-bit quantized version for lower memory use and faster inference while retaining the same architecture and chat format.
mlx-openai-server is the best fit if you want OpenAI-compatible endpoints, streaming responses, structured outputs, reasoning/tool-call parsing, and easy integration with existing clients.