ECHR Retrieval by Isaacus is a challenging legal information retrieval evaluation dataset consisting of 200 short summaries of findings of European Court of Human Rights decisions paired with the text of those decisions sourced from the HUDOC database.
This dataset is intended to stress test the ability of an information retrieval model to retrieve relevant court decisions given arbitrary legal holdings.
This dataset forms part of the Massive Legal Embeddings… See the full description on the dataset page:
https://huggingface.co/datasets/isaacus/echr-retrieval.