🚀 A2C CartPole-v1

🌎 Environment

• Gym ID: CartPole-v1
• Max Episode Length: 500 steps

🧠 Model Configuration

• Algorithm: Advantage Actor-Critic (A2C)
• Policy Network: Multi-Layer Perceptron (MLP)
• Architecture: [64, 64]
• Learning Rate: 5e-3
• Gamma (Discount factor): 0.99
• N Steps per Update: 5
• Max Gradient Norm: 0.5
• Total Training Timesteps: 50,000

📊 Evaluation

• Evaluation Frequency: every 100 timesteps
• Evaluation Mode: Deterministic
• Video of the trained agent: Watch the agent 🎬

📈 Logged Metrics

• Episode Reward
• Episode Length
• Accuracy (reward / max_steps_per_episode)

🔗 Links

• Weights & Biases Project