Is this your dataset? Claim it with the Hugging Face account that owns it.

leibnitz-lab/
colinear_scaling_models

Name: colinear_scaling_models
Creator: leibnitz-lab
License: https://spdx.org/licenses/GPL-2.0-only.html

gpl-2.0

Views

No views yet

	license: gpl-2.0




	
	Collinear Scaling Models

Checkpoint repository for scaling law experiments comparing collinear (CO) and non-collinear (NC) experimental designs.

Directory Structure

{dataset}/{design}/N_{param_count}/

Dataset: wikipedia, pes2o, cosmopedia, redpajama, c4 (plus _fp16 and _bigtpp variants) Design: colinear or non_colinear N: Model parameter count (one of 14 canonical sizes from ~5M to ~70M)

Experimental Designs

Collinear (CO):… See the full description on the dataset page: https://huggingface.co/datasets/leibnitz-lab/colinear_scaling_models.