IOL-AI 2026 — gemma4:12b hybrid (symbolic numeral solver + budget-managed LLM)
Three-pass pipeline:
- Symbolic pass —
numeral_solver.py brute-forces numeral systems
(base, word values, word-order convention) from the problem's own
examples and answers text_to_num / num_to_text exactly when a
consistent system exists; otherwise falls through to the LLM.
- Baseline pass — a fast low-token answer for every remaining
problem, with
submission.csv atomically checkpointed after every row.
- Upgrade pass — per-row time-sliced reasoning with per-task-type
method prompts; a baseline answer is replaced only when the upgrade
parses to the correct number of answers. Translation reasoning is
deliberately capped low: on gemma4-12B, truncated reasoning plus a
forced short answer scored measurably higher than completed reasoning.
Model: gemma4-12B (Apache 2.0), weights shipped in this repo, loaded 4-bit
via bitsandbytes at startup (fp16 12B does not fit the 16 GB T4).
Upload checklist (before submitting)
- Put the gemma4-12B weight files (safetensors + config + tokenizer) in
the repo root so
script.py loads them from ".".
- Repo must be public at submission time.
- Submit via the competition Space; the platform mounts the hidden test
set at
/tmp/data/test.csv and runs script.py.