Warm-Up Round: 10 hours left ยท Ending 09 Jul 21:59 UTC #neurips #reinforcement_learning

Want to dive straight in? Make your first submission in 10 minutes!

This challenge tackles a key problem in the transportation world: 
How to efficiently manage dense traffic on complex railway networks?

This is a real-world problem faced by many transportation and logistics companies around the world such as the Swiss Federal Railways and Deutsche Bahn. Your contribution may shape the way modern traffic management systems are implemented, not only in railway but also in other areas of transportation and logistics!

๐Ÿš‚ Background

The Flatland challenge aims to address the problem of train scheduling and rescheduling by providing a simple grid world environment and allowing for diverse experimental approaches.

This is the second edition of this challenge. In the first one, participants mainly used solutions from the operations research field. In this second edition we are encouraging participants to use solutions which leverage the recent progress in reinforcement learning.

๐Ÿ”— The Flatland environment

๐Ÿ”— Past winning solutions

Flatland preview

Flatland: the core task of this challenge is to manage and maintain railway traffic on complex scenarios in complex networks

๐Ÿ“œ Tasks

Your goal is to make all the trains arrive at their target destination with minimal travel time. In other words, we want to minimize the number of steps that it takes for each agent to reach its destination. At the more basic levels, the agents may achieve their goals using ad-hoc decisions. But as difficulty increases from round to round, the agents have to be able to plan ahead, i.e. with increasing difficulty, planning becomes more relevant!


Problem example: this is a teaser of what we expect you to do

A central question while designing an agent is the observations used to take decisions. As a participant, you can either work with one of the base observations that are provided or better, design an improved observation yourself!

These are the three provided observations:

  • Global Observation: The whole scene is observed.
  • Local Grid Observation: A local grid around the agent is observed.
  • Tree Observation: The agent can observe its navigable path to some predefined depth.

๐Ÿ”— Observations in Flatland

๐Ÿ”— Create custom observations

โš– Evaluation metrics

The primary metric is the mean normalized return from your agents - the higher the better.

The minimum possible value is -1.0, which occurs if none of the agents reach their goal during the episode. The maximum possible value is 0.0, which would occur if all the agents reached their targets in one time step, which is generally not achievable.

The agents have to act within strict time limits. You are allowed up to 5 minutes of initial planning time before any agent moves. Beyond that point, the agents have 5 seconds per time step to indicate their next actions. If the agents fail to act in time, the submission will fail.

๐Ÿ”— Evaluation metrics

๐Ÿ”— Time limits

๐Ÿ† Prizes

The prizes are four travel grants to the NeurIPS 2020 conference โœˆ๏ธ

  • The first place team in the final round will be awarded one travel grant, whichever approach they use.
  • The top three teams in the final round which use a reinforcement learning approach for their winning submission will be awarded one travel grant each.

The approach used for each submission needs to be specified in the aicrowd.json file as described in the submission guide.

The winning submissions will be verified manually by the organizers to ensure the method used matches what has been declared in the aicrowd.json file. The organizers have the final word when judging the validity of each submission.

If the overall first place team uses a reinforcement learning approach, then this team will be awarded two travel grants.

๐Ÿ“… Timeline

Here's the tentative timeline:

  • June 1st - July 7th: Warm-Up Round
  • July 8th - July 31st: Round 1
  • August 1st - October 19th: Round 2
  • October 20th - October 25th: Post Challenge Analysis
  • October 25th: Final Results Announced
  • October 16th - November 10th: Post Challenge Wrap-Up

There are no qualifying round. Participants can join the challenge at any point until the final deadline.

๐Ÿš‰ Next stops

The Flatland documentation contains everything you need to know to get started with this challenge!

Want to dive straight in? 
๐Ÿ”— Submit in 10 minutes

New to multi-agent reinforcement learning? 
๐Ÿ”— Step by step guide

Want to explore advanced solutions such as distributed training and imitation learning?
๐Ÿ”— Research baselines

๐Ÿ“ฑ Contact

Join the Discord channel to exchange with other participants!

If you have a problem or question for the organizers, use either the Discussion Forum or open an issue:

We strongly encourage you to use the public channels mentioned above for communications between the participants and the organizers. But if you're looking for a direct communication channel, feel free to reach out to us at:

  • mohanty [at] aicrowd.com
  • florian [at] aicrowd.com
  • erik.nygren [at] sbb.ch

For press inquiries, please contact SBB Media Relations at press@sbb.ch

๐Ÿค Partners




01 vetrov_andrew -0.195
02 Zain -0.412
03 student -0.644
04 junjie_li -0.723
05 fabianpieroth -0.858

Latest Submissions

syin submitted
apat1n failed
apat1n failed
manavsinghal157 graded
mahkons graded