Beta

Explore
Marketplace
Neural Labs
Chat
Wallet
Docs

Beta

Explore Marketplace Neural Labs Wallet Docs

Build

Manage

My assets Manage wallet Organization

Community

Discord X (Twitter)Telegram

Docs Privacy Policy Terms and Conditions

Proud member of

Proud member of

Docs Cookie Policy

Privacy Policy Terms and Conditions

© 2026 AlphaNeural AI. All rights reserved.

ppo-LunarLander-v2 – AI Model by CharithAnupama | AlphaNeural AI

You can deploy this model and start earning money today!

CharithAnupama/
ppo-LunarLander-v2

like

0

reinforcement-learning

custom-implementation

Views

No views yet

PPO Agent Playing LunarLander-v2

Trained with a PPO implementation from scratch (CleanRL-style) in PyTorch.

Results

Mean reward: 8.59
Std reward: 73.34

Hyperparameters

exp_name: ppo_from_scratch
seed: 1
cuda: 1
env_id: LunarLander-v2
total_timesteps: 400000
learning_rate: 0.00025
num_envs: 8
num_steps: 128
anneal_lr: 1
gamma: 0.99
gae_lambda: 0.95
num_minibatches: 4
update_epochs: 4
clip_coef: 0.2
ent_coef: 0.01
vf_coef: 0.5
max_grad_norm: 0.5
repo_id: CharithAnupama/ppo-LunarLander-v2
batch_size: 1024
minibatch_size: 256