Views
No views yet
| Configurations | Values |
|---|---|
| Hardware (Training and Inference) | 8xA100s |
| Tracking | wandb |
| batch size | 16 |
| gradient_checkpointing | True |
| learning_rate | 1.0e-5 |
| lr_scheduler_type | cosine |
| max_length | 131072 |
| num_train_epochs | 1 |
| optim | adamw_torch |
@misc{pham2025clippercompressionenableslongcontext,
title={CLIPPER: Compression enables long-context synthetic data generation},
author={Chau Minh Pham and Yapei Chang and Mohit Iyyer},
year={2025},
eprint={2502.14854},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2502.14854},
}