Activity
Ratings Progression
Challenge Categories
Challenges Entered
Understand semantic segmentation and monocular depth estimation from downward-facing drone images
Latest submissions
See Allgraded | 208984 | ||
failed | 208983 |
Audio Source Separation using AI
Latest submissions
See Allfailed | 208761 |
Identify user photos in the marketplace
Latest submissions
See Allfailed | 209217 | ||
failed | 209215 | ||
failed | 209214 |
A benchmark for image-based food recognition
Latest submissions
Interactive embodied agents for Human-AI collaboration
Latest submissions
See Allfailed | 196525 | ||
failed | 196516 | ||
failed | 196513 |
What data should you label to get the most value for your money?
Latest submissions
Behavioral Representation Learning from Animal Poses.
Latest submissions
Airborne Object Tracking Challenge
Latest submissions
ASCII-rendered single-player dungeon crawl game
Latest submissions
Latest submissions
Improving the HTR output of Greek papyri and Byzantine manuscripts
Latest submissions
Multi-Agent RL for Trains
Latest submissions
Machine Learning for detection of early onset of Alzheimers
Latest submissions
5 Puzzles 21 Days. Can you solve it all?
Latest submissions
Sample Efficient Reinforcement Learning in Minecraft
Latest submissions
Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments
Latest submissions
Robustness and teamwork in a massively multiagent environment
Latest submissions
3D Seismic Image Interpretation by Machine Learning
Latest submissions
See Allgraded | 82855 | ||
graded | 82679 | ||
graded | 82664 |
Latest submissions
Play in a realistic insurance market, compete for profit!
Latest submissions
Multi-Agent Reinforcement Learning on Trains
Latest submissions
A dataset and open-ended challenge for music recommendation research
Latest submissions
See Allfailed | 197464 |
A benchmark for image-based food recognition
Latest submissions
See Allgraded | 109590 | ||
failed | 109586 | ||
failed | 109578 |
Sample-efficient reinforcement learning in Minecraft
Latest submissions
Latest submissions
Predicting smell of molecular compounds
Latest submissions
See Allgraded | 101429 | ||
graded | 101420 | ||
graded | 81550 |
Classify images of snake species from around the world
Latest submissions
See Allfailed | 5795 | ||
graded | 392 | ||
failed | 391 |
Find all the aircraft!
Latest submissions
5 Problems 21 Days. Can you solve it all?
Latest submissions
5 Puzzles 21 Days. Can you solve it all?
Latest submissions
Robots that learn to interact with the environment autonomously
Latest submissions
5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?
Latest submissions
Grouping/Sorting players into their respective teams
Latest submissions
Reinforcement Learning on Musculoskeletal Models
Latest submissions
See Allgraded | 18446 | ||
graded | 10385 | ||
graded | 10099 |
Disentanglement: from simulation to real-world
Latest submissions
See Allgraded | 21050 | ||
graded | 13148 | ||
graded | 13117 |
Sample-efficient reinforcement learning in Minecraft
Latest submissions
See Allgraded | 18575 | ||
graded | 15152 | ||
graded | 11232 |
Multi Agent Reinforcement Learning on Trains.
Latest submissions
See Allfailed | 18455 | ||
failed | 18370 | ||
failed | 18105 |
Visual SLAM in challenging environments
Latest submissions
Latest submissions
ACL-BioNLP Shared Task
Latest submissions
Project 2: Road extraction from satellite images
Latest submissions
Robots that learn to interact with the environment autonomously
Latest submissions
See Allgraded | 11208 | ||
failed | 11198 | ||
failed | 11193 |
Immitation Learning for Autonomous Driving
Latest submissions
A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning
Latest submissions
See Allgraded | 7057 | ||
graded | 664 | ||
graded | 663 |
ACL-BioNLP Shared Task
Latest submissions
Predict if users will skip or listen to the music they're streamed
Latest submissions
Spot the Boson
Latest submissions
5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?
Latest submissions
Predict if users will skip or listen to the music they're streamed
Latest submissions
See Allfailed | 197463 |
Predict viewer reactions from a large-scale video dataset!
Latest submissions
Detect Multi-Animal Behaviors from a large, hand-labeled dataset.
Latest submissions
Multi-Agent Reinforcement Learning on Trains
Latest submissions
Use an RL agent to build a structure with natural language inputs
Latest submissions
See Allfailed | 196525 | ||
failed | 196516 | ||
failed | 196513 |
Estimate depth in aerial images from monocular downward-facing drone
Latest submissions
Perform semantic segmentation on aerial images from monocular downward-facing drone
Latest submissions
See Allgraded | 208984 | ||
failed | 208983 |
Music source separation of an audio signal into separate tracks for vocals, bass, drums, and other
Latest submissions
Participant | Rating |
---|---|
![]() |
132 |
![]() |
136 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
![]() |
0 |
Participant | Rating |
---|
Cinematic Sound Demixing Track - CDX'23

Feedback and suggestion
2 months ago@andrey1362010 : A person who is a citizen of Russia and is currently a resident of another eligible country, with an active bank account present in that eligible country, is eligible to receive prizes.

Feedback and suggestion
3 months agoApologies for the relative radio silence due to the holiday season.
GPUs
We are still waiting for a response from the organizing team about the provision of GPUs, so we will have to hold off on answering the question until we hear back from the organizing team.
Throughputs
We are investigating the issue with differential throughputs across different evaluations. A new instance is instantiated for every evaluation on our cloud provider, and the instance type is exactly the same - and hence the resources available. We have confirmed that the exact same instance type is being made available to all the submissions as well. We will get back to you with more details on this soon as well.
Timeouts
The current timeouts are 1hr, or 60 mins.
Apologies on the slow response times due to the Holiday season. We will be providing support at full capacity again starting 2nd of January, 2023.
Best,
Mohanty

Evaluation failed due to system error
3 months ago@yoyololicon : It seems that the evaluators are unable to open some of the generated files. Can you please test locally if you can read the generated predictions using PySoundFile.
Best,
Mohanty

Feedback and suggestion
4 months ago@lyghter : The team leader will be the main legal POC with AIcrowd, and the prizes will be transferred to the team leader. Any prize-sharing agreements between the team leader and the rest of the team members are internal to the team.

Feedback and suggestion
4 months agoWe are discussing this with the organizing committee, and will get back to you soon on this.

Feedback and suggestion
4 months ago@lyghter : Unfortunately, residents of Russia are not eligible for the prizes in the Challenge. And in case, a leaderboard position is held by a team which is not eligible for the prizes, then the prizes will indeed be rolled over to the next position (and at this point, it will not be possible for us to logistically allow non eligible teams to pass on the prizes to a charity). The rules have been updated to categorically reflect that.

Feedback and suggestion
4 months agoWe are constantly trying to make this challenge better for you and would appreciate any feedback you might have .
Please reply to this thread with your suggestions and feedback on making the challenge better for you!
- What have been your major pain points so far?
- What would you like to see improved?
Cheers,
SDX Challenge Team

Looking for teammates?
4 months agoCompeting is more fun with a team!
Introduce yourself here, and find others who are looking to team up!
Format
- A short introduction about you and your background.
- What brings you to this challenge?
- Some ideas you wish to explore as a part of this challenge ?
Cheers,
SDX Challenge Team
SUADD'23- Scene Understanding for Autonomous Drone

About my submissions
3 months ago@victorkras2008 : can you please try again. You should be able to access the submission lists on both the challenges.

About my submissions
3 months ago@victorkras2008 : You should be able to see all your submissions in the submissions tab, for ex: AIcrowd | Semantic Segmentation | Submissions

π¬ Feedback and suggestion
3 months ago@ricardodeazambuja : Yes the observation is correct.
As described here:
The dataset contains 422 flights, 2056 total frames (5 frames per flight at different AGLs), Full semantic segmentation annotations of all frames and depth estimations. The dataset has been split into training and (public) test datasets. While the challenge will be scored using a private test dataset, we considered it useful to have this split to allow teams to share their results even after the challenge ends.
Of the total frames available, a subset if used for the (public) test set that you are currently being scored on. There will be an additional (private) test set that the final leaderboards will be based on. And submissions are currently limited to 5 submissions / day.
Best,
Mohanty

π₯ Looking for teammates?
3 months ago
π¬ Feedback and suggestion
3 months agoMono Depth Perception

About leaderboard sorting
3 months ago@victorkras2008 : yes the sorting on the leaderboard is correct. In case of Scale invariant logarithmic error (SILog), a lower score is better.

Bad link to "Baseline for Mono Depth Perception" π
3 months ago@victorkras2008 : Thanks for pointing it out.The links are correct, we realized that theres a few more things that need to be updated in the repo before they can be made public. So sorry for the confusion, we will try to make the repositories public as soon as we can.
Thanks,
Mohanty
NeurIPS 2019 : MineRL Competition

Evaluation failed: Findcave Inference: Error (exit code 1): ValueError: Not allowed to access task
5 months ago@slai7880 : the Findcave
reference in the logs for the intro track is a bug only specific to the logs, and because of how we are re-using the evaluators from the other track.
In case of the intro track, the Findcave
rollout is hot-patched to use the ObtainDiamond
env instead. So the logs show Findcave
even if it is actually using ObtainDiamond
. Sorry for the confusion.
Regarding the error at your end, this is because, of this line: AIcrowd
where during the evaluation phase, the participant submitted agents are not allowed to access the internal env specific parameters like env.task
. This is to prevent agents from interfering with the internal state of the env during the evaluation.
Best,
Mohanty
NeurIPS 2022: MineRL BASALT Competition

Debug Submission with debug=false
5 months ago@k_sashank : The link above doesnt point to the issue page.
However we noticed that debug
is set to False in your master branch. But the code used in your last submission (AIcrowd) still uses debug
as True.
Please make a new submission from the master branch of your code repository.
NeurIPS 2022 IGLU Challenge

Getting run failures without any logs
6 months ago@felipe_b : The issue with the logs not showing for some submissions has been fixed. The logs from the latest failure is available here : AIcrowd
It seems that the software runtime specification is not done correctly, and the image build phase fails because some of the dependencies are not specified correctly.
Submission failed : Failed to communicate with the grader
About 2 months agoThis issue has been resolved now. Please do let us know if you continue to face this issue.
Best,
Mohanty