Quantization made by Richard Erkhov.
Llama3.2-1B-summary-length-exp5 - AWQ
Original model description:
library_name: transformers
tags: []
Model Card for Model ID
- Summary Length PPO experiment #5
- No KL divergence in loss
Model Details
- Dataset size: 1024
- Epochs: 1
- Batch Size: 4 * 8 (w/ Gradient Accumulation)
Optimizer args: Torch AdamW default, except