1cargo install cortiq-cli
2hf download infosave/LFM2.5-cmf lfm2.5-2.6b-q4tp.cmf --local-dir .
3cortiq run lfm2.5-2.6b-q4tp.cmf --prompt "Explain what a Fourier transform does, in two sentences."
LiquidAI's LFM2.5 is a hybrid: most layers
mix with a short gated convolution and only a few carry full attention, so the
state a token needs is small and constant where the convolution runs. These are
those checkpoints in the
CMF container —
a single memory-mapped file read by
cortiq, a Rust binary with no ML framework
under it. GPU via Vulkan/Metal/DX12 with a CPU fallback; NVIDIA, AMD, Intel and
Apple silicon read the same file.
On a discrete card the whole token runs as one submitted graph, conv ring
and expert routing included; the MoE's greedy output is token-identical to
the CPU path. On Apple silicon the engine measures both arms at startup and
picks; for the 2.6B the host arm wins there, and CMF_GPU=0 pins it.
1curl localhost:8080/v1/chat/completions -H 'content-type: application/json' \
2 -d '{"model":"lfm2.5","messages":[{"role":"user","content":"Say hello"}]}'