A filtered extract of terminal and command-line content from two large web-text corpora, designed for upsampling agentic-adjacent data during pretraining.

	Subsets

Subset Rows Tokens Size Quality

clean (default) 2.33M 4.6B 11 GB ~98% terminal content

unfiltered 61.3M 359B 962 GB ~15% terminal content

from datasets import load_dataset

Load the clean subset (default)

ds = load_dataset("AdaMLLab/WebTerminal")

Load the unfiltered… See the full description on the dataset page: https://huggingface.co/datasets/AdaMLLab/WebTerminal.