search-reranker-irishgov-l5-k10-v2

Intended use

• Best use: direct CPU reranking of the RRF -> top10 candidate set.
• Recommended runtime profile: ONNX dynamic q8, max_length=140, threads=10.
• Not the best stage-1 prefilter for the older 80-candidate stress path; the public l6-fast -> broad cascade remains the better larger-pool fallback.

Why v2

• keeps perfect bilingual office-holder ranking
• improves the broader gov finephrase test
• improves the fresh unseen hard K=10 holdout a03
• keeps the same CPU operating point for the deployed K=10 path

Key q8 benchmarks

Comparison to previous and other public lines

Runtime note

• q8 ONNX
• max_length=140
• threads=10
• proxy throughput = 28.27 qps
• average query latency = 35.37 ms
• p95 query latency = 40.81 ms

Artifacts

• Raw HF checkpoint: ./
• ONNX dynamic q8 artifact: onnx/model_quantized.onnx

Training provenance

• Base lineage: cross-encoder/mmarco-mMiniLMv2-L12-H384-v1
• Immediate parent: reranker_mmarco_mminilm_l5_irishgov_k10s5a
• Training mix: pairmix_k10_stage5_v1
• This run specifically re-aligned the model toward stronger short-length deployment while preserving the K=10 in-domain supervision.

Caveats

• This release is tuned for K=10 serving and should be evaluated that way.
• The old K=80 stress path is still a secondary evaluation axis, not the main promotion gate.

Portfolio comparison

General bilingual rerankers

Policy rerankers

Dynamic q8 CPU at K=20

• proxy_k20: policy=none
• broad_policy_k20: policy=gov_broad_v1
• office_holder_k20: policy=office_holder_v1
• fixed threads=10, batch_size=32

• search-reranker-broad-v1: the local reports include strong fp32 ONNX proxy and office data, but not a matching fp32 in-domain finephrase / hard-K10 / holdout-A03 set, so those are not claimed here.
• search-reranker-irishgov-l5-k10-v2: the local non-quantized reports are trustworthy for office / finephrase / hard-K10, but not for the same proxy runtime shape as the shipped q8 path.
• search-reranker-irishgov-l6-fast-v1: the local non-quantized reports cover proxy and office, but not the fresh holdout-A03 slice used for the q8 K=10 comparison.