smcleish/

scaling-laws-cache

This dataset is my cache for the scaling-laws related to the gemstone models. In data_cache is the approach 3 data cache with the mins for delta=1e-4, the mins for delta=1e-3 are in mins_1e-3. This is the code I used to upload it: import pandas as pd from datasets import Dataset import os import gc

def get_data_dict(path): contents = os.listdir(path)

ds_store = {}
for i, file in enumerate(contents):
    gc.collect()
    df = pd.read_parquet(f"{path}{file}")
    for… See the full description on the dataset page: https://huggingface.co/datasets/smcleish/scaling-laws-cache.