brew install redhillsmediafl/caix/caix
caix catalog install redhillsmediafl/rhm-gemma-4-e2b-it-mm-staged-caix
caix serve --model gemma4-e2b-it-mm-QAT-splitcache-singleasset-staged-4bit-ctx128k-2x13-22

At a glance

Base model: google/gemma-4-E2B-it-qat-q4_0-unquantized
Context: 131,072 tokens (matches base model)
Quantization: QAT 4-bit Core AI
Disk: 3.7 GB
Runs on: Apple silicon with caix 0.2.13-beta+

Status

Package	Runtime	Hardware	RAM	Model	Prompt	Output tokens	Median tok/s
staged package	staged/distributed	Apple silicon	-	-	package-specific staged request	-	pending verified result
staged package	local same-machine staged	Apple silicon	-	-	default decode	-	pending verified result

For optimized single-device speed, use redhillsmediafl/rhm-gemma-4-e2b-it-mm-monolithic-caix.

caix catalog performance-report --model ~/.caix/models/exports/gemma4-e2b-it-mm-QAT-splitcache-singleasset-staged-4bit-ctx128k-2x13-22 --repo redhillsmediafl/rhm-gemma-4-e2b-it-mm-staged-caix

License

Gemma license

_{More open-source work: redhillsmediafl.com/open-source.}