Supra-Router-51M is an ultra-lightweight (51.7M param) infrastructure routing model. Given a user prompt, it predicts whether the request should be handled by a local edge SLM or triaged to a cloud-hosted frontier model, via a multi-task decision sequence (domain, complexity, math/code flags, then the final route).

Architecture


Base model	Supra-Router-51M (Llama arch, ~51.7M params)
Quantization	MX FP8 (micro-scaled 8-bit float)
Bits per weight	8.252
Disk size	53 MB (from ~101 MB fp16)
Format	MLX (safetensors)

Usage

python

from mlx_lm import load, generate

model, tokenizer = load("sahilchachra/supra-router-51m-mxfp8-mlx")

prompt = "Task: Write a movie script about a chef who gets lost at sea.\nAnalysis: "
out = generate(model, tokenizer, prompt=prompt, max_tokens=100, verbose=False)
print(out)

This model does not use a chat template — wrap the raw user query in the training-time framing tokens shown above (Task: [prompt]\nAnalysis: ). It emits a deterministic, pipe-separated telemetry string:

Domain: [Semantic Field] | Complexity: [1-5] | Math: [True/False] | Code: [True/False] | Route: [small model/big model] | Justification: [...]

CLI:

bash

mlx_lm.generate --model sahilchachra/supra-router-51m-mxfp8-mlx \
  --prompt "Task: Explain quantum entanglement.\nAnalysis: " \
  --max-tokens 100

Routing accuracy (50-sample held-out eval)

50 prompts sampled (seed=42) from the model's own training data, SupraLabs/Prompt-Routing-Dataset (992 rows total), scored against the dataset's ground-truth routing_choice/math_task/coding_task/complexity_score labels. Each variant loaded fresh via mlx_lm.load and run through mlx_lm.generate with greedy decoding, parsing the model's own pipe-separated output.

Variant	Route accuracy	Math flag accuracy	Code flag accuracy	Complexity exact-match	Agreement with FP16
fp16	98%	100%	100%	92%	—
mxfp4	94%	100%	100%	84%	96%
mxfp8	94%	98%	100%	88%	96%

Route accuracy — the field that actually drives the small-model/big-model dispatch decision — stays within 4 points of FP16 for both quantized variants (94% vs 98%).
Zero parse failures across all 150 generations (50 samples × 3 variants); the pipe-separated output format survives quantization intact.
Both quantized variants agree with FP16's routing decision on 96% of samples (48/50) — the 2 disagreements are complexity-boundary prompts, not wholesale routing failures.

Smoke test

Verified against the model's documented "keyword-trap evasion" example plus a code-routing example, run through mlx_lm.generate on all variants:

Prompt: "Task: Write a movie script about a chef who gets lost at sea.\nAnalysis: "
Output: Domain: Film scripting | Complexity: 2 | Math: False | Code: False | Route: small model | ...

Prompt: "Task: Write a Python function to compute the nth Fibonacci number using dynamic programming.\nAnalysis: "
Output: Domain: Programming | Complexity: 2 | Math: False/True | Code: True | Route: big model | ...

Both quantized variants reproduce the same routing decision (Route: small model / Route: big model) as the FP16 original on both prompts — the compression preserves the model's core routing behavior.

Other MLX variants

Credits

Base model: SupraLabs/Supra-Router-51M
Quantization tooling: mlx-lm