• Model creator: https://huggingface.co/amang1802/
• Original model: https://huggingface.co/amang1802/Llama3.2-1B-summary-length-exp6.1/

Original model description:

library_name: transformers tags: []

Model Card for Model ID

• Summary Length PPO experiment #6.1
• No KL divergence in loss
• Loss = -P*R/sum(P), instead of Loss = (log(P)*R).mean()

Model Details

• Dataset size: 1024
• Epochs: 1
• Batch Size: 4 * 4 (w/ 4 GPUs) * 8 (w/ Gradient Accumulation)

• LR = 0.00001