No performance or quality claims are made for these files. Local validation only confirms that the listed GGUFs load and respond on the tested hardware/runtime.

Files

File	Quant	Size	SHA256
`North-Mini-Code-1.0-ik_llama-Q8_0.gguf`	Q8_0	33,007,688,960 bytes	`2e8139305d30f31ed7a5834c32113f9c6ce5d004bf0ec9008be6da0a20928a50`
`North-Mini-Code-1.0-ik_llama-Q6_K.gguf`	Q6_K	25,522,707,712 bytes	`8661540adc05ccba8cd90e36ca0f29101586a7e201090bc503db1ca11cb4d37d`
`North-Mini-Code-1.0-ik_llama-Q4_K_M.gguf`	Q4_K_M	18,991,947,008 bytes	`0dfed0306ef9e0a7887bac556494e4e36b65b116c48976cb0d8283fd48a006cd`

Source And Build Notes

Source model: CohereLabs/North-Mini-Code-1.0
Source revision used locally: effaeda477c041c107d5a3d8c599cb5d6c5878ef
Converter/runtime support: ik_llama.cpp main after PR #1945, or an equivalent build with cohere2_moe support
Build commit used for these artifacts: 1e063a6bd Enhance Cohere2-MoE support by modifying tensor handling and configuration logic
Conversion intermediate: BF16 GGUF, then quantized with llama-quantize
Embedded chat template: source chat_template.jinja
Embedded chat template SHA256 prefix: d8366efb9f07c571
Tokenizer pre-tokenizer marker: tokenizer.ggml.pre=cohere2_moe

Relevant metadata present in all listed GGUFs:

general.architecture=cohere2_moe
tokenizer.ggml.pre=cohere2_moe
tokenizer.chat_template is embedded and matches the source chat_template.jinja

Validation

Validation was run locally on an RTX 4070 workstation with an ik_llama.cpp build containing Cohere2-MoE / North-Mini-Code support.

Checks performed:

BF16 conversion completed successfully.
Q8_0, Q6_K, and Q4_K_M quantization completed successfully.
Metadata was inspected after quantization.
The embedded chat template in Q8_0, Q6_K, and Q4_K_M exactly matched the source chat_template.jinja.
Q8_0, Q6_K, and Q4_K_M loaded through llama-server with the Cohere2-MoE runtime path.
Q8_0, Q6_K, and Q4_K_M passed a short OpenAI-compatible chat sanity check.
Q8_0, Q6_K, and Q4_K_M were also exercised through a local OpenCode configuration against an OpenAI-compatible endpoint and produced code in that harness.

These checks are compatibility smokes only. They are not benchmark results and should not be interpreted as performance, quality, or agentic coding claims.

Compatibility

These files require ik_llama.cpp main after PR #1945, or another runtime with equivalent cohere2_moe architecture, tensor-loading, tokenizer, and graph support.

They are not expected to load or decode correctly in runtimes that do not yet understand general.architecture=cohere2_moe.

ji-farthing/North-Mini-Code-1.0-ik-llama-validation-GGUF

North-Mini-Code-1.0 GGUFs converted with ik_llama.cpp

Files

Source And Build Notes

Validation

Compatibility

ji-farthing/
North-Mini-Code-1.0-ik-llama-validation-GGUF