brew install redhillsmediafl/caix/caix
caix catalog install redhillsmediafl/rhm-glm-4-9b-0414-bf16-caix
caix serve --model glm-4-9b-0414-bf16-coreai-ctx32768

At a glance

Base model: zai-org/GLM-4-9B-0414
Context: 32,768 tokens (matches base model)
Quantization: BF16 Core AI
Disk: 17.5 GB
Runs on: Apple silicon with caix 0.2.13-beta+

Status

Package	Runtime	Hardware	RAM	Model	Prompt	Output tokens	Median tok/s
this package	standalone	Apple M1 Ultra	64 GB	Mac Studio (2022)	default decode	128	pending verified result

caix catalog performance-report --model ~/.caix/models/exports/glm-4-9b-0414-bf16-coreai-ctx32768 --repo redhillsmediafl/rhm-glm-4-9b-0414-bf16-caix

License

MIT

_{More open-source work: redhillsmediafl.com/open-source.}