Views
No views yet
| Field | Value |
|---|---|
| model_config | 1B_llama3.2 |
| init_from | meta-llama/Llama-3.2-1B-Instruct |
| max_subtokens | 3 |
| max_codebook_size | 4096 |
| seq_len | 4096 |
| lr | 5e-05 |
| max_tokens | 1000000000 |
| step | 1908 |
| data | zip2zip_1b |
1python scripts/zip2zip_hf/export_to_zip2zip.py \
2 --ckpt_dir <local_path>/step_1908 \
3 --output_dir <export_dir> \
4 --base_model meta-llama/Llama-3.2-1B-Instruct \
5 --model_config 1B_llama3.2