This dataset is the pchanumolu/huge-context-size-test dataset with the Llama 2 prompt format described here. Here is the code I used to format it: from datasets import load_dataset

dataset = load_dataset('pchanumolu/huge-context-size-test')

def merge_columns(example): ifexample['input']: merged = f"[INST] <>\nBelow is an instruction that… See the full description on the dataset page: https://huggingface.co/datasets/pchanumolu/huge-context-size-test.