A Korean legal precedent retrieval benchmark built to be hard enough to measure
progress. 6,000 practitioner-style queries over 59,786 Korean court precedents.
Public Korean retrieval benchmarks are largely saturated — off-the-shelf models score
above 0.90 nDCG@10 on several of them, so they can no longer separate a good retriever
from a very good one.
The obvious legal alternative has the same problem in a subtler form. The… See the full description on the dataset page:
https://huggingface.co/datasets/ysmeta/EVE-Bench-Legal-1.0.
