Views
No views yet
1cargo install cortiq-cli
2hf download infosave/Ornith-1.5-cmf ornith-1.5-9b-q4tp.cmf --local-dir .
3cortiq run ornith-1.5-9b-q4tp.cmf --prompt "Explain quicksort in three sentences."cortiq, a Rust binary with no ML
framework under it. GPU via Vulkan/Metal/DX12 with a CPU fallback.| file | params | layers | size |
|---|---|---|---|
ornith-1.5-9b-q4tp.cmf | 9B | 32 (8 attention / 24 linear) | 4.37 GB |
ornith-1.5-35b-a3b-q4tp.cmf | 35B total, 3B active | 40 (10 attention / 30 linear), 256 experts, 8 per token + shared | 17.4 GB |
q4tp), quantized straight from the
bf16 checkpoints, MTP draft head included. The upstream repos are
vision-language; these files carry the text tower — image input is not
part of the container.cortiq bench --core, single stream, A100 80GB over
Vulkan, cortiq 0.5.99. The whole token runs as one submitted graph —
linear-attention state, expert routing and the draft head included.| A100 80GB (Vulkan) | Apple M4 (Metal) | |
|---|---|---|
| 9B | 73 tok/s | 20 tok/s |
| 35B-A3B | 65 tok/s (first token pays a one-off ~10 s expert upload) | — |
cortiq serve ornith-1.5-9b-q4tp.cmf --port 8080.cmf ships a .sha256 beside it.