zhqwqwq/

NCPL-Pretraining-Logs

Pretraining logs collected from:

Marin Project: https://github.com/marin-community/marin Step Law Project: https://github.com/step-law/steplaw

Each example corresponds to one training run, including the training configuration and performance metrics (C4-en evaluation loss for Marin, and smoothed pretraining loss for StepLaw).

from datasets import load_dataset

marin = load_dataset("zhqwqwq/NCPL-Pretraining-Logs", "marin", split="train") steplaw =… See the full description on the dataset page: https://huggingface.co/datasets/zhqwqwq/NCPL-Pretraining-Logs.