Views
No views yet
| Field | Value |
|---|---|
| model_config | 1B |
| init_from | scratch |
| max_subtokens | 4 |
| max_codebook_size | 4096 |
| seq_len | 4096 |
| lr | 0.0003 |
| max_tokens | 20000000000 |
| step | 19074 |
| data | llaza-20B-tokens-128shards |
1python scripts/zip2zip_hf/export_to_zip2zip.py \
2 --ckpt_dir <local_path>/step_19074 \
3 --output_dir <export_dir> \
4 --base_model scratch \
5 --model_config 1B