Muennighoff/

babi

For the bAbI as used in Scaling Data-Constrained Language Models use commit e332ae8a626bb17178026dd14797abb9da31376e Creation (Copied & adapted from https://github.com/stanford-crfm/helm/blob/0eaaa62a2263ddb94e9850ee629423b010f57e4a/src/helm/benchmark/scenarios/babi_qa_scenario.py): !wget http://www.thespermwhale.com/jaseweston/babi/tasks_1-20_v1-2.tar.gz !tar -xf tasks_1-20_v1-2.tar.gz import json from typing import List

tasks = list(range(1, 21)) splits = ["train", "valid", "test"]

def… See the full description on the dataset page: https://huggingface.co/datasets/Muennighoff/babi.