search-reranker-broad-policy-v6

Name: search-reranker-broad-policy-v6
Rating: 2.5 (7 reviews)

Broad-policy serving release for gov search.

This is a policy-only release over temsa/search-reranker-broad-policy-v5:

same raw weights
same q8 ONNX artifact family
corrected temporal intent handling for budget-year and latest press-release queries
cleaner office-holder routing
new recommended route-specific serving profiles

Recommended serving profiles

Broad policy queries:

policy: gov_broad_v1
backend: onnx
threads: 10
max length: 176

Office-holder identity queries:

policy: office_holder_v1
backend: onnx
threads: 10
max length: 160

Why `v6` exists

The previous synthetic policy suite encoded a temporal-label conflict: some budget YYYY rows rewarded publication-year matching instead of the policy year described in the content.

v6 keeps the same model weights, but the bundled serving policy now prioritizes the corrected temporal behavior and the new corrected holdouts.

Key q8 results

Suite	`v6`
Corrected policy holdout v5 MRR@10	0.8657
Office valid MRR@10 (`160`)	1.0000
Office holdout v2 MRR@10 (`160`)	1.0000
Office holdout v3 MRR@10 (`160`)	1.0000
Legacy policy holdout v4 MRR@10 (`176`)	0.9444
Legacy policy all v2 MRR@10 (`176`)	0.9167

Representative throughput:

corrected policy holdout v5 (224): 25.74 qps
office valid (160): 33.10 qps
office holdout v3 (160): 34.23 qps
legacy policy holdout v4 (176): 26.93 qps

Important note on evaluation

The corrected temporal holdouts are now the main gate for:

budget YYYY queries
latest press-release queries
latest-turn overrides in multi-turn chat input

The older broad-policy synthetic suite is still shipped for continuity, but should be treated as a legacy reference rather than the primary temporal gate.

Portfolio comparison

Updated 2026-03-20 from local reranker reports only.

Use this section as the side-by-side public temsa reranker view. Cells are intentionally left out or summarized when the local report set does not contain a trustworthy non-quantized benchmark for the same public path.

General bilingual rerankers

Repo	Primary role	Non-quantized path	Quantized path	Extra trustworthy signals
`temsa/search-reranker-broad-v1`	Broad final-stage reranker	ONNX fp32 `l256`: proxy 0.9490 / 2.08 qps	Sibling q8 `l160`: proxy 0.9458 / 8.41 qps	office 0.8056; hard-k10 0.9815; holdout-a03 0.8759
`temsa/search-reranker-broad-v1-qint8`	Broad CPU q8 sibling	See `temsa/search-reranker-broad-v1`	ONNX q8 `l160`: proxy 0.9458 / 8.41 qps	office 0.8056; hard-k10 0.9815; holdout-a03 0.8759
`temsa/search-reranker-irishgov-l6-fast-v1`	Fast stage-1 / cascade prefilter	PT `l192`: proxy 0.9192 / 7.99 qps	ONNX q8 `l128`: proxy 0.9218 / 27.25 qps	office 1.0000; holdout-a03 0.9259
`temsa/search-reranker-irishgov-l6-fast-v2`	Fast K=10 policy serving release	Same raw checkpoint family as v1; q8 with corrected temporal + office policy is the recommended path	ONNX q8 `l160/t10`: corrected holdout-v5 1.0000 / 47.68 qps	office-holdout-v3 1.0000; office-valid 1.0000; legacy-holdout-v4 0.9375
`temsa/search-reranker-irishgov-l6-fast-v3`	Fastest public K=10 serving profile	Same raw checkpoint family as v2; the value is the shorter recommended serving length on corrected gates	ONNX q8 `l128/t10`: corrected holdout-v5 1.0000 / 48.27 qps	office-holdout-v3 1.0000; office-valid 1.0000; legacy-holdout-v4 0.9444
`temsa/search-reranker-irishgov-l6-fast-v4`	Current best fast K=10 reranker	Margin-MSE style continuation over v3; q8 per-channel is the recommended deployed artifact	ONNX q8 per-channel `l128/t10`: corrected holdout-v5 1.0000 / 50.78 qps	office-holdout-v3 1.0000; office-valid 1.0000; legacy-holdout-v4 0.9444
`temsa/search-reranker-irishgov-l6-fast-v5`	Fast K=10 serving release with shorter broad-policy route	Same raw checkpoint family as v4; the value is a shorter broad-policy serving profile while keeping the office route unchanged	ONNX q8 per-channel `gov_broad_v1` `l104/t10`: corrected holdout-v5 1.0000 / 55.77 qps	fresh-holdout-v6 0.8917; office-holdout-v3 1.0000; office-valid 1.0000
`temsa/search-reranker-irishgov-l5-k10-v1`	Fast K=10 direct reranker	PT `l160`: proxy 0.8800 / 1.32 qps	ONNX q8 `l140`: proxy 0.8872 / 28.72 qps	office 1.0000; hard-k10 0.9815; holdout-a03 0.9630
`temsa/search-reranker-irishgov-l5-k10-v2`	Current K=10 successor	PT `l128`: office 1.0000, finephrase 0.9405	ONNX q8 `l140`: proxy 0.8853 / 28.27 qps	office 1.0000; holdout-a03 1.0000

Policy rerankers

Repo	Primary role	Non-quantized path	Quantized path	Extra trustworthy signals
`temsa/search-reranker-broad-policy-v1`	Broad policy-tuned reranker	PT `l224`: policy-all 0.9270 / 7.94 qps	ONNX q8 `l224`: policy-all 0.9205 / 27.55 qps	office 0.9537; holdout-a04 0.9049
`temsa/search-reranker-broad-policy-v3`	Current broad policy successor	ONNX fp32 `l224`: policy-all 0.9259 / 15.75 qps	ONNX q8 `reduce_range` `l224`: policy-all 0.9268 / 30.12 qps	office 0.9676; holdout-v3 0.9286
`temsa/search-reranker-broad-policy-v4`	Current broad policy serving release	Same raw checkpoint family as v3; q8 gov_broad_v1 is the recommended path	ONNX q8 `reduce_range` + `gov_broad_v1` `l224`: policy-all 0.9257 / 31.64 qps	office 0.9676; holdout-v3 0.9271; holdout-v4 0.9583
`temsa/search-reranker-broad-policy-v5`	Current broad policy serving release	Same raw checkpoint family as v4; q8 gov_broad_v1 is the recommended path	ONNX q8 `reduce_range` + `gov_broad_v1` `l224/t10`: policy-all 0.9711 / 26.12 qps	office 1.0000; holdout-v3 1.0000; holdout-v4 1.0000
`temsa/search-reranker-broad-policy-v6`	Broad policy serving release with corrected temporal gate	Same raw checkpoint family as v5; q8 gov_broad_v1 + office_holder_v1 is the recommended path	ONNX q8 `gov_broad_v1` `l176/t10`: corrected holdout-v5 0.8657 / 25.74 qps	office-l160 1.0000; legacy-holdout-v4 0.9444; legacy-policy-all 0.9167
`temsa/search-reranker-broad-policy-v7`	Broad policy serving release with stronger latest-turn and topic-specific news routing	Same raw checkpoint family as v6; q8 gov_broad_v1 + office_holder_v1 is the recommended path	ONNX q8 `gov_broad_v1` `l176/t10`: fresh holdout-v6 0.9375 / 15.65 qps	office-l224 1.0000; office-holdout-v4 0.9659; corrected-holdout-v5 1.0000; legacy-policy-all 0.9196
`temsa/search-reranker-broad-policy-v8`	Broad policy serving-profile release with shorter broad and office routes	Same raw checkpoint family as v7; q8 gov_broad_v1 + office_holder_v1 is the recommended path	ONNX q8 `gov_broad_v1` `l160/t10`: fresh holdout-v7 0.9500 / 29.85 qps	office-l208 1.0000; office-holdout-v3 1.0000; office-holdout-v4 0.9659; fresh-holdout-v6 0.9500
`temsa/search-reranker-broad-policy-v9`	Broad policy serving release with stronger year-specific change-history routing	Same raw checkpoint family as v8; q8 gov_broad_v1 + office_holder_v1 is the recommended path	ONNX q8 `gov_broad_v1` `l160/t10`: gov.ie category-policy corrected 1.0000 / 26.01 qps	legacy-policy-all 0.9282; fresh-holdout-v6 0.9500; office-valid 1.0000; office-holdout-v4 0.9659

Dynamic q8 CPU at K=20

These rows use the current local K=20 benchmark harness:

proxy_k20: policy=none
broad_policy_k20: policy=gov_broad_v1
office_holder_k20: policy=office_holder_v1
fixed threads=10, batch_size=32

Repo	Broad len	Office len	Proxy K=20	Broad-policy K=20	Office-holder K=20	Notes
`temsa/search-reranker-broad-v1`	160	160	0.9458 / 6.93 qps	0.9437 / 9.10 qps	0.6073 / 8.23 qps	broad baseline
`temsa/search-reranker-broad-v1-qint8`	160	160	0.9458 / 6.65 qps	0.9437 / 6.62 qps	0.6073 / 5.91 qps	q8 sibling repo
`temsa/search-reranker-broad-policy-v1`	224	224	0.9414 / 7.20 qps	0.9125 / 11.32 qps	0.6966 / 6.49 qps	first policy model
`temsa/search-reranker-broad-policy-v2`	224	224	0.9414 / 6.44 qps	0.9125 / 9.40 qps	0.6966 / 7.75 qps	office-policy serving fix era
`temsa/search-reranker-broad-policy-v3`	224	224	0.9364 / 7.38 qps	0.9250 / 12.20 qps	0.7451 / 7.15 qps	custom CPU continuation
`temsa/search-reranker-broad-policy-v4`	224	224	0.9364 / 7.16 qps	0.9250 / 11.40 qps	0.7451 / 6.90 qps	gov_broad_v1 serving route
`temsa/search-reranker-broad-policy-v5`	224	224	0.9364 / 7.00 qps	0.9250 / 12.35 qps	0.7451 / 6.47 qps	stronger serving release
`temsa/search-reranker-broad-policy-v6`	176	160	0.9433 / 8.09 qps	0.9250 / 9.97 qps	0.7186 / 9.77 qps	corrected temporal gate
`temsa/search-reranker-broad-policy-v7`	176	224	0.9433 / 7.91 qps	0.9250 / 12.11 qps	0.7451 / 7.49 qps	stronger latest-turn routing
`temsa/search-reranker-broad-policy-v8`	160	208	0.9371 / 9.49 qps	0.9250 / 11.21 qps	0.7527 / 7.01 qps	current broad fallback
`temsa/search-reranker-broad-policy-v9`	160	208	0.9371 / 8.97 qps	0.9250 / 11.56 qps	0.7527 / 6.62 qps	current broad fallback + change-history fix
`temsa/search-reranker-irishgov-l5-k10-v1`	140	140	0.8872 / 15.56 qps	0.8938 / 21.68 qps	0.6751 / 21.01 qps	fast K=10 direct
`temsa/search-reranker-irishgov-l5-k10-v2`	140	140	0.8853 / 18.06 qps	0.8854 / 18.87 qps	0.6327 / 17.93 qps	fast K=10 successor
`temsa/search-reranker-irishgov-l6-fast-v1`	128	128	0.9286 / 18.70 qps	0.9042 / 17.65 qps	0.6934 / 20.36 qps	fast stage-1 v1
`temsa/search-reranker-irishgov-l6-fast-v2`	128	128	0.9286 / 18.59 qps	0.9042 / 19.67 qps	0.6934 / 19.30 qps	fast stage-1 v2
`temsa/search-reranker-irishgov-l6-fast-v3`	128	128	0.9286 / 18.48 qps	0.9042 / 18.60 qps	0.6934 / 19.30 qps	shorter serving profile
`temsa/search-reranker-irishgov-l6-fast-v4`	128	128	0.9184 / 17.66 qps	0.9008 / 21.83 qps	0.7197 / 17.31 qps	margin-MSE per-channel
`temsa/search-reranker-irishgov-l6-fast-v5`	104	128	0.8987 / 20.85 qps	0.9133 / 20.29 qps	0.7197 / 15.45 qps	current fast route

Intentional gaps:

search-reranker-broad-v1: the local reports include strong fp32 ONNX proxy and office data, but not a matching fp32 in-domain finephrase / hard-K10 / holdout-A03 set, so those are not claimed here.
search-reranker-irishgov-l5-k10-v2: the local non-quantized reports are trustworthy for office / finephrase / hard-K10, but not for the same proxy runtime shape as the shipped q8 path.
search-reranker-irishgov-l6-fast-v1: the local non-quantized reports cover proxy and office, but not the fresh holdout-A03 slice used for the q8 K=10 comparison.

temsa/search-reranker-broad-policy-v6