bowang0911/

fineweb-2-autocurate

Autonomously curated subsets of HuggingFaceFW/fineweb-2. An LLM agent iteratively samples documents, identifies quality problems, and proposes heuristic fixes. Each fix is validated by training a small language model for 5 minutes and measuring BPB improvement on a Wikipedia eval set. Only fixes that improve BPB are kept. Built with autocurate.

	Subsets




	

Language Subset Original Docs Kept Docs Kept % BPB Before → After Improvement

Danish… See the full description on the dataset page: https://huggingface.co/datasets/bowang0911/fineweb-2-autocurate.