alirezaaminzadeh/

or-reasoning-benchmark-results

Execution-based evaluation for the OR Reasoning model across classification, formulation, and code generation tasks.

	Metrics




	

Metric Description

compile_rate Generated Pyomo code passes syntax/structure check

feasibility_rate Model has objective, variables, and constraints

objective_match_rate Objective within 15% of ground truth

optimal_rate Objective within 2% of ground truth