----------------------------------------------- - Model Details and Specifications: - -----------------------------------------------
----------------------------------------------- - Update July 11th 2026 - -----------------------------------------------
Fixed MMPROJ Multi-Modal Vision projector. (Re-Uploaded with working projector)
Uploaded brand new Q2_K_M, Q3_K_M, Q4_K_M, Q5_K_XL, Q6_K_L quants, using the GH5TS method! These offer significantly higher performance and quality of response over previously uploaded release files with the same or similar size of file!
All files are being re-Uploaded with brand new and custom Quantize formulae: Over the next couple days the files will be updated with the new "GH5TS" (Pronounced: Ghosts) Quant method! This quantization method is a dynamic quantizaton that bases all quants no matter the size to include Q5_K in layers that are critical to cognitive abilities of the model while allowing for lower Quantization bit values for non-crucial layers.
New chat template! Yes, a new chat template that completely fixes previous issues for llama.cpp users and retains even higher performance than the originally made template for Ollama/Xllama users as well!
Description:
This model was re-configured with MistralAI's original Magistral-Small vision tower,
using only official MistralAI files, weights and model data. This has resulted in a
Vision Multimodal version of Magistral-Small-2509 including fully functional Vision (re-enabled).
The Chat-template and System-prompt have been reworked and customized to improve
performance and quality across all Quantizated Files. No modifications,
edits, or additional configurations are required to use this model with Ollama/Llama.cpp
Both Vision and Text work. (^.^)
This release contains:
Llama.cpp, Ollama, and Xllama compatible GGUF converted and Quantized model files (Compatible with Xllama, Ollama, and Llama.cpp)
IMPORTANT NOTICE as of (GMT-8) 07:00 July 11th 2026:
Please note: The chat-template AND the system-prompt have been rewritten and finalized but differ from what
MistralAI made available. You can still use MistralAI's default template and prompt, however it is recommended to be
using what is provided within this release. Below is a copy of the new chat template (Default System Message Removed for Ease of Reading).
Chat Template:
jinja
1{%- set ns = namespace(remMessage=false, hasSys=false, injSystem=true) -%}
2{%- for msg in messages -%}
3 {%- if msg.role == "system" -%}
4 {%- set ns.hasSys = true -%}
5 {%- endif -%}
6{%- endfor -%}
7{{- bos_token }}
8{%- for msg in messages -%}
9 {%- if ns.injSystem -%}
10 [SYSTEM_PROMPT]
11 {%- if ns.hasSys -%}
12 {{ msg.content }}
13 {%- else -%}
14 'Default System Message Is provided in the actual GGUF file here'
15 {%- endif -%}
16 [/SYSTEM_PROMPT]
17 {%- set ns.injSystem = false -%}
18 {%- endif -%}
19 {%- if (messages|length - loop.index0) < 29 -%}
20 {%- set ns.remMessage = true -%}
21 {%- endif -%}
22 {%- if ns.remMessage -%}
23 {%- if msg.role == "user" -%}
24 [INST]
25 {%- if msg.content is string %}
26 {{ msg.content }}
27 {%- else %}
28 {%- for block in msg.content %}
29 {%- if block.type == 'text' %}
30 {{- block.text }}
31 {%- if block.type in ['image', 'image_url'] %}
32 [IMG]
33 {%- endif %}
34 {%- endfor %}
35 {%- endif %}
36 [/INST]
37 {%- elif msg.role == "assistant" -%}
38 {{ msg.content }}
39 {%- endif -%}
40 {%- endif -%}
41 {{- eos_token }}
42{%- endfor -%}
Happy LLM Inferrencing,
-- Jon Z (EnlistedGhost)
--------------------------------------------------- - Conversion and GGUF Quantization: - ---------------------------------------------------
Quantized GGUF version of:
EnlistedGhost/Magistral-Small-2509-Vision (by MistralAI - modified by EnlistedGhost)
-------------------------------------- ---- How to run this Model ---- --------------------------------------
Compatible Software (Required to use this Model)
You can run this model by using either Ollama (or) Llama.cpp (Below are instruction on running these GGUF files with Ollama)
How to run this Model using Ollama
You can run this model by using the "ollama run" command.
Simply copy & paste one of the commands from the list below into
your console, terminal or power-shell window.
Quant Type
File Size
Command
QX_X
0.00 GB
(Currently Uploading Files, Check again very soon!)
