This repository contains self-contained MLX bundles for NVIDIA C-RADIOv4 image embedding models on Apple Silicon.

Implementation repository:

Each subdirectory contains:

Measured against local bf16 MLX bundles at 512x512 on 12 WALDO crop images.

The 8-bit affine bundles are the recommended compact/high-precision artifacts, not the throughput tier. They are packed weight-only MLX artifacts and are not dequantized back to dense bf16 at load time. Cider W8A8 is the real weight/activation low-bit runtime path for Apple M5+ machines and trades a little more embedding drift for lower memory and modest speedups in some cells. The mxfp8 bundles are included for experimentation and are lower precision in these checks.

Smoke-image Cider W8A8 precision versus local bf16 MLX at 512x512:

WALDO 12-image Cider W8A8 precision versus local bf16 MLX at 512x512:

MLX measurements on Apple M5 Max at 512x512, batch 1:

There are no supported dequantize-at-load artifacts in this repository. The MLX affine and mxfp8 bundles keep weights packed but are weight-only, so they prioritize compact storage and lower runtime weight memory over throughput. Cider W8A8 is the faster weight/activation low-bit runtime path found so far, but it requires Apple M5+ hardware and the optional Cider package.

Install the implementation package from the GitHub repository, then point --checkpoint at one of the downloaded subdirectories:

The g128 variants are the balanced Cider choice. The p99.99 variants are faster and slightly lower precision; validate them against downstream task metrics before replacing bf16 or g128.

Use --backend mlx-h for the H model:

Cider W8A8 bundles require Python >=3.12, Apple M5+ hardware, and Cider:

The implementation code in c-radio_v4_MLX is MIT licensed. The model weights and these converted bundles are governed by NVIDIA's Open Model License Agreement, not by the MIT license. Preserve NVIDIA provenance and license terms when redistributing these bundles.

NVIDIA Open Model License Agreement: