Gold tasks for policy-issuance QC: a structured underwriting binder, a structured issued policy, and the exact discrepancy set. Images are not stored. Re-render with suture_forge.generate.render_doc from the GitHub repo.
Paper and adapter: caiotheodoro/suture · caiotheodoro/suture-8b. Predictions on this gold: caiotheodoro/suture-evals.
benchmark
777
1000
Contracted held-out set. Never in train.
validation
7 holdout
80… See the full description on the dataset page:
https://huggingface.co/datasets/caiotheodoro/suture.
