mindware/

arc-codet5-660m-scr

• Span-Corruption Refinement (SCR): The model was trained with an additional pretraining objective I call SCR (chosen because of the model's deep history of training with the span corruption objective). The answer is noised with heavy span corruption and data augmentation (to mimic incorrect answers) and passed along with the prompt for refinement (model outputs the full corrected grid). Note: This did not result in better performance when used during inference (only used during TTT).

• RE-ARC — procedurally generates examples for the 400 ARC training tasks (we also include RE-ARC eval + ARC 1.5).
• ConceptARC
• 1D-ARC
• ARC_gym, Sort-of-ARC
• Andreas Koepf’s generator suites (includes RE-ARC-style grids, code generation targets, and solution graphs).
• Jack Cole’s custom generators covering ~70 tasks plus larger concept sets (cellular automata, math-derived boards, etc.).

ARC Data Formatting

• ARC tasks ship as JSON where each task_id contains train pairs and test inputs; every grid is a rectangular list of lists with integers 0-9. Dimensions follow the original 1×1–30×30 spec, though the evaluator accepts up to 50×50.
• Example task payload:
  json

  1{ 2 "task_id": { 3 "train": [ 4 {"input": [[0,0],[1,1]], "output": [[1,1],[1,1]]} 5 ], 6 "test": [ 7 {"input": [[0,0,0],[0,1,0],[0,0,0]]} 8 ] 9 } 10}
• Model prompts (prompt column during training/TTT/inference) are serialized text strings: solve: train input1 <train_input> output1 <prefix><train_output>. … test tinput1 <test_input> toutput1 . Each grid token <train_input> / <train_output> / <test_input> is produced by grid_to_string, so rows are concatenated digits separated by spaces. Multiple train examples increment the index (input2, output2, etc.).
• Prompt example:
  solve: train input1 000 010 000 output1 11 3 3 10 111 101 111. input2 00 02 output2 5 2 2 20 22 20. test tinput1 0000 0300 0000 0000 toutput1
• Model targets (correct_answer column and expected decoder output before post-processing) follow output_prefix semantics: {total_chars} {height} {width} {symbols} {row_strings}. Here total_chars = height*width + (height - 1) and symbols is the deduplicated sequence of colors as they are first encountered when scanning the board row-major; that rule applies to every output grid we emit (training outputs inside the prompt and the predicted test toutput). Example target string for a 3×3 donut:
  11 3 3 10 111 101 111.