Hey! This pops up randomly. I would requeue the submission but the same bug seems to make this impossible from my end .
Can you resubmit your solution? I can remove failed solutions for you so you get submission quota back
Hmm it might have not updated because the score is has not improved over the debug submission, but this is just a finnicky thing of the leaderboard.
Hey! Make sure you have pushed the changes and that you have tagged the submission after the change. If that does not help, please share the issue page of your submission so I can take a look
Hey! Sorry about this, still looking into this . The BASALT side has gotten bit more attention as it is the main track, but now those errors are fixed for now so intro track will get some love!
@mohanty Would you have any idea what could be bugged up here?
Hey. Sorry for the headache: we are just about to share the full dataset, though, which will use the same storage method as the other OpenAI VPT data they shared! That one you will be able to curl/wget easily :). Stay tuned; we will announce this on Discord and update the AICrowd main page with the link.
Hey there! The code is running correctly, it is just closing the environment that sometimes (or always) throws an error on Windows. You can ignore this error for now. If you want code to continue after calling
env.close, wrap it around try-except blocks.
Hey. Sadly there are no news as of yet, so you have not missed anything. Stuff might now how happen now that holidays are over but I can not promise when.
Hey. There is no API to get this information in MineRL environments right now, so no. That info is just for aicrowd evaluation.
Hey. Unfortunately the tight schedule requested by NeurIPS competition board is making it a bit difficult to extend deadlines further. We will likely only extend deadline if more technical issues crop up that require more days to handle.
Hey! I assume this is the number of participants invited to the workshop to present their submissions etc? Ideally we would like to invite all Round 2 finalists + some from Intro track, depending on how NeurIPS workshop is structued! We will let you know when we have the exact numbers
Prizes are to be determined (but they are coming!)
The deadline was set to 15th October initially, but rules indeed make it sound different.
I will let Nicholay (our rules guy) answer the question for final confirmation
Hey! Sorry for the delay (we are more active on the Discord server).
In Intro track, you are free to use the data in any way possible. In Research track, however, you are not allowed to have such fine-grained selection (unless it is selected by a trained neural network).
Ah! I assume you refer to the figure here? https://github.com/minerllabs/competition_submission_template (Edit: I have removed the said figure from the github page. It had text “max. 20 submissions”)
That information is wrong, and for now there are unlimited number of submissions (but with a daily cap). Thanks for pointing this out tho! I will fix it.
Failed submissions are counted as submissions as well, as long they started the building stage (this, too, takes quite a bit of resources to run).
Hey. The submission quota refreshes daily, but in a pinch @Shivam or someone else from AICrowd can requeue your submission if it fails in docker build phase (sorry, I did not notice your message on gitlab up until now).
Nope, no per-step limitations. I would recommend that the MineRL environment will work if you have very long delays between step calls (it should not matter, but easier to check locally than on the evaluation server )
Hey! Sorry for the delay!
The baseline code was tested to work during release but sadly it seems like some of the dependencies have been updated since and it breaks this code . My wild guess is that
imitation repository has changed. Your best bet is to checkout older version of
imitation and installing that (a manual process…).
An easier step would be to double-check you have the up-to-date library versions as specified by
environment.yml, but I assume this is already the case.