Views
No views yet
PPO-trained reinforcement learning agent for cross-DEX arbitrage on Ethereum/L2s. v15f closes the real-data gap discovered in v15d validation.
| Metric | v15d (real) | v15f (real) | Delta |
|---|---|---|---|
| Bad Execute Rate | 41.2% | 1.3% | -39.9pp |
| Skip Rate | 15.2% | 50.9% | +35.7pp |
| Good Execute Rate | 43.9% | 47.7% | +3.8pp |
| Composite Score | -0.467 | 0.603 | +1.070 |
| Sharpe Ratio | 1.67 | 5.32 | +3.65 |
| Avg PnL | 300 | 274 | -26 |
| Active Strategies | 10 | 11 | +1 |
| Criterion | Target | Actual | Status |
|---|---|---|---|
| Real bad_exec | < 15% | 1.3% | PASS |
| Real skip_rate | > 30% | 50.9% | PASS |
| Real composite | > 0.0 | 0.603 | PASS |
| Composite improved | > v15d | 0.603 | PASS |
| Bad exec reduced | < v15d | 1.3% | PASS |
| No synthetic regression | comp > 0.30 | 0.458 | PASS |
| Metric | v15d (synth) | v15f (synth) |
|---|---|---|
| Composite | 0.408 | 0.458 |
| Sharpe | 5.29 | 6.55 |
| Bad Execute | 0.0% | 3.4% |
| File | Description |
|---|---|
flashmind_ppo_v15f_best.zip | Best model (real composite 0.603) |
flashmind_ppo_v15f_final.zip | Final checkpoint (step 200K) |
v15f_vecnormalize.pkl | VecNormalize stats (real-data calibrated) |
flashmind_ppo_v15d_final.zip | Previous best (synthetic-only) |
v15d_vecnormalize.pkl | Previous norm stats (synthetic-only) |
backtest_v15_comprehensive.json | Full backtest of v15b/v15c/v15d/v15e |
v15f_vs_v15d_comparison.json | Real-data comparison v15d vs v15f |
training_v15f_results.json | v15f training metadata |
1from stable_baselines3 import PPO
2from stable_baselines3.common.vec_env import DummyVecEnv, VecNormalize
3
4model = PPO.load('flashmind_ppo_v15f_best.zip')
5# MUST use v15f_vecnormalize.pkl for proper observation normalization| Version | Key Change | Real Comp | Synth Comp |
|---|---|---|---|
| v15c | First discrimination | N/A | Failed |
| v15d | norm_reward=False | -0.467 | 0.408 |
| v15e | LR decay + early stop | N/A | 0.440 |
| v15f | Real-data fine-tuning | +0.603 | 0.458 |