Quantization made by Richard Erkhov.
Llama3.2-1B-summary-length-exp2 - AWQ
Original model description:
library_name: transformers
tags: []
Model Card for Model ID
- Summary Length PPO experiment #2
- No KL divergence in loss
Model Details
- Dataset size: 1024
- Epochs: 2
- Batch Size: 4 * 8 (using Grad Accu)
Optimizer args: Torch AdamW default, except