Is this your dataset? Claim it with the Hugging Face account that owns it.

jhu-clsp/
ettin-decay-data

Name: ettin-decay-data
Creator: jhu-clsp
License: https://spdx.org/licenses/MIT.html

Views

No views yet

Ettin Decay Phase Data

Phase 3 of 3: Premium data sources for final training phase (100B tokens) following the ProLong recipe.

This dataset contains the decay phase data used to train all Ettin encoder and decoder models. This final phase uses premium data sources with emphasis on long-form content and educational materials. The data is provided in MDS format ready for use with Composer and the ModernBERT training repository.

Abstract

The large language model (LLM)… See the full description on the dataset page: https://huggingface.co/datasets/jhu-clsp/ettin-decay-data.