Llama 3.2 1B — Stateful KV Cache Core ML (unified model)

Structure

ctx{N}_fp16/Llama32_1B_KVCache/   — FP16 unified model
ctx{N}_int4/Llama32_1B_KVCache/   — INT4 unified model (optional)

Usage

• OS: macOS 15 / iOS 18+
• Compute units: CPU_AND_GPU
• Inference: make_state(); prefill + decode with the same model; see notebook Step 9 for causal_mask shapes.