# Get the engine
git clone https://github.com/JustVugg/colibri && cd colibri/c && ./setup.sh

# download this repo to a FAST local disk
hf download mateogrgic/GLM-5.2-colibri-int4-with-int8-mtp --local-dir /nvme/glm52

# run on CPU
COLI_MODEL=/nvme/glm52 ./coli chat

Requirements: Linux (or WSL2), gcc + OpenMP, AVX2, ≥16 GB RAM, ~400 GB free NVMe.

Provenance & license

Converted from zai-org/GLM-5.2-FP8 (MIT). This derivative is likewise MIT. Conversion performed with colibrì's official converter, unmodified. Cloned & modded from jlnsrk/GLM-5.2-colibri-int4

gubernac/GLM-5.2-colibri-int4-with-int8-mtp

GLM-5.2 — colibrì int4 container (~370 GB)

Usage

Provenance & license

gubernac/
GLM-5.2-colibri-int4-with-int8-mtp