Marine Biology - Continued Pre-Training Dataset
Description
A corpus of Wikipedia articles covering marine biology and related domains, intended for continued pre-training (CPT) of language models on marine science knowledge.
Content
Plain text articles scraped from Wikipedia across the following categories: