LexRubric: A Rubric-Guided Diagnostic Benchmark for Open-Ended Legal Tasks
LexRubric is designed for legal questions that require free-form, context-sensitive responses. Unlike closed-form legal benchmarks based on multiple-choice accuracy, exact matching, or fixed answer structures, LexRubric evaluates model responses with expert-written atomic rubrics.
The benchmark contains 649 instances from two complementary sources:
