Each agent is evaluated over 300 episodes
Maximum steps per episode: 60
Environment starts with the robot in the top-left
Rewards:
- +10: extinguish fire and reach goal
- –1: step penalty
- –5: invalid actions or skipping steps

🛠 Setup

pip install -r requirements.txt

🚀 Evaluate Your Agent

Clone the repo:

bash

git clone https://huggingface.co/spaces/YOUR_USERNAME/firefighter-gridworld-leaderboard
cd firefighter-gridworld-leaderboard

Run evaluation:

python evaluation/evaluate_custom_agent.py --path ./my_agent.zip --algo PPO

Submit your eval_results.json via Pull Request.

🧠 Environment API

Custom environment follows Gymnasium standards:

python

import gymnasium as gym
from env.firefighter_env import FireFighterEnv

env = FireFighterEnv()
obs, info = env.reset()
for _ in range(60):
    action = env.action_space.sample()
    obs, reward, terminated, truncated, info = env.step(action)
    if terminated or truncated:
        break

📥 Submissions

Include in your Pull Request:

eval_results.json
Description of your model and training setup
GIF of successful episode (optional)

📦 Files

env/ – environment code
agents/ – training scripts (PPO, DQN, MCTS)
evaluation/ – evaluation and rendering
models/ – saved agents
assets/ – sprites and animation

📜 License

MIT License. Contributions welcome!

Punit71/firefighter-gridworld-leaderboard

🚒 Firefighter GridWorld Leaderboard

📊 Leaderboard (300 Episodes)

🧪 Evaluation Protocol