This is a 2bit quantization of the Mistral Large Instruct 2411 model for MLX (Apple silicon). It was created using the mlx-lm library with the following CLI command:
mlx_lm.convert
--hf-path /path/to/your/fp16/model
-q
--q-bits 2
--q-group-size 32
Each version is optimized for specific memory and performance trade-offs.
The original Mistral-Large-Instruct-2411 model is available
here. Mistral model usage is governed by the
Mistral Research License.
This model family is governed by the
Mistral Research License. Please review the license terms before use.
The Mistral-Large-Instruct-2411-MLX family includes quantized versions of the Mistral Large Instruct 2411 model, optimized for deployment on MLX (Apple Silicon). The quantization reduces memory usage and inference latency, enabling efficient deployment on resource-constrained systems.
