Qwen2.5-7B-Instruct with layers 8-12 duplicated. The math circuit runs twice on every forward pass.
28 base layers → 32 after duplication. No training, no merging, no weight changes.
The math specialist. The first sub-14B model the method was extended to. David Ng demonstrated layer-duplication on Qwen2-72B; we found it works just as cleanly here, 10× smaller. Of 51 swept configurations, (8,12) is the one that gets the math circuit alone — duplicate that 4-layer block and nothing else trades down. The original GitHub-issue writeup describing exactly this result lives in the v2 corpus:
docs/github-issue-draft.md.
51 configurations tested. Full sweep data in the v2 corpus dataset. For vLLM-serving with AWQ quantization, see companion repo
john-broadway/Qwen2.5-7B-RYS-8-12-AWQ.
Part of the RYS Sovereign Collection v1.
v2 — cross-architecture extension. 21 model variants across 10 architecture families. Headline: weak baselines lift more, in their weakest dimension. →
john-broadway/rys-sovereign-collection-v2
John Broadway, with collaboration from Claude (Opus 4.6 in April 2026 build; Opus 4.7 in May 2026 analysis and publication). Original RYS method by
David Ng on Qwen2-72B; sweep toolkit by
alainnothere.