This was your last successful submission on 24th November which is already updated since a few days. Failed submissions are not run on the real track. But seems like the your submission was consistently turning towards the right side so the score is lower than your previous submission.
Please check all your other successful submissions
after 20th November and let me know in case any are missing, we were running the best submission per user per day until recently. We’ll run any older ones in case any are missing.
Please let me know if I can help with anything else, I’ll try my best but might be bit delayed since I’m travelling today.
Sorry I missed reply to this this post earlier.
The reward function for both the rounds is staying close to the center, this is a proxy reward but its good enough as the action space does not allow stopping. The score on the simulation leaderboard is indeed the mean cumulative reward over multiple episodes. The maximum possible reward in both rounds may vary as the tracks are different.
But the main idea of the competition is the sim2real transfer and the formula for the real track is based on waypoints crossed and time. The final prizes are based on the real track leaderboard and a small weightage on the simulation scores. I’ll make a separate post to clarify the formula for the real track.
The much awaited Round 2 of the Deepracer Challenge is now live. Submissions will now be run on a real deepracer track everyday until November 30th.
The submission flow will be a follows:
Each team is allowed upto 5 successful submissions everyday, these will run on the Round 2 simulator.
The top scoring submission from each team each day will be run on the real track.
Since the time remaining for Round 2 is short, we encourage everyone to train their models on the Round 2 simulator as soon as possible.
There will be no obstacles on the track, but sim2real transfer will not be a trivial task. Be on the lookout for on board videos from your submissions to help you fine tune your solutions. All the best!!
We’re in the process of setting up the track, thanks for the patience.
Hi @charel_van_hoof, could you try once with git bash on Windows. I’ll try to check but I think nle is currently not support on windows. But just the ttyplay2 script might work.
BSuite gives the limit of 10000 as a fair amount episodes needed to converge.
Generally speaking, to have a level playing field among all competitors, while also not making it too easy, some constraint has to he applied. In this case, the number of episodes serves that role.
I know the number 10000 may be arbitrary, so if enough students feel it should be increased, we’ll do it. For now please try to improve your algorithm to get the highest score with 10000 episodes.
Can you check if your local scoring cell is working without any error.
In case your local scoring cell gives an error its probably because the output format is wrong, check the targets file for the output format.
If your local scoring cell gives no error please let me know.
Sounds like a formatting issue with the code on your end, since its not a general issue that affects all students I encourage you to find the bug on your own. With correct format you should get decimals for all algorithms in the local scoring code. Look at the targets for example of the format.
Do let me know in case the problem still persists after you’ve checked it thoroughly.
Yes, you can use training data of Task 1 for 2 and 3. Feel free to use all the data at your disposal.
You can even use some unsupervised learning on the test sequences.
Its not important for submission.
[Explainer] - EDA of Seismic data by geographic axis Here’s my EDA notebook on how the seismic data varies by geographic axis, along with some ideas for training.