Loading

Shubhamaicrowd

Organization

AIcrowd

Badges

0
0
0

Activity

Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Machine Learning for detection of early onset of Alzheimers

Latest submissions

No submissions made in this challenge.

Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments

Latest submissions

No submissions made in this challenge.

ASCII-rendered single-player dungeon crawl game

Latest submissions

See All
graded 150340

Self-driving RL on DeepRacer cars - From simulation to real world

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Sample Efficient Reinforcement Learning in Minecraft

Latest submissions

See All
failed 150449

Latest submissions

No submissions made in this challenge.

3D Seismic Image Interpretation by Machine Learning

Latest submissions

No submissions made in this challenge.

Airborne Object Tracking Challenge

Latest submissions

No submissions made in this challenge.

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Robustness and teamwork in a massively multiagent environment

Latest submissions

See All
graded 150842
graded 150841
graded 150839

Play in a realistic insurance market, compete for profit!

Latest submissions

No submissions made in this challenge.

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

See All
failed 152094

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

See All
graded 149018
graded 148506
graded 147406

A benchmark for image-based food recognition

Latest submissions

No submissions made in this challenge.

Sample-efficient reinforcement learning in Minecraft

Latest submissions

No submissions made in this challenge.

5 Puzzles, 3 Weeks. Can you solve them all? 😉

Latest submissions

See All
graded 136936
graded 135991
graded 135988

Multi-agent RL in game environment. Train your Derklings, creatures with a neural network brain, to fight for you!

Latest submissions

No submissions made in this challenge.

Predicting smell of molecular compounds

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

5 Problems 21 Days. Can you solve it all?

Latest submissions

See All
graded 122965
graded 122961
graded 122960

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

See All
graded 128820
failed 128427
failed 126803

5 Puzzles, 3 Weeks | Can you solve them all?

Latest submissions

See All
graded 118013
graded 117983
graded 117917

5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

5 Problems 15 Days. Can you solve it all?

Latest submissions

See All
failed 141470
failed 141469

Recognise Handwritten Digits

Latest submissions

No submissions made in this challenge.

Crowdsourced Map Land Cover Prediction

Latest submissions

No submissions made in this challenge.

5 Problems 15 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?

Latest submissions

No submissions made in this challenge.

ACL-BioNLP Shared Task

Latest submissions

No submissions made in this challenge.

Detect F1 Cars

Latest submissions

See All
graded 135991
graded 135988
graded 135987

Classify F1 Cars Body

Latest submissions

See All
graded 136936
graded 134005
graded 128429

Extrapolate Time Series Data

Latest submissions

See All
graded 114974

Color Black and White Images

Latest submissions

See All
graded 117917
graded 115153

Predict moves of a chess piece from video snippet

Latest submissions

No submissions made in this challenge.

Identify which side has least players

Latest submissions

No submissions made in this challenge.

Predict the winner through prior chess moves

Latest submissions

See All
graded 122965
graded 122961
graded 122960

Predict Mars Planet Rotation

Latest submissions

See All
failed 128427

Classify Stages of Mars Spacecraft

Latest submissions

No submissions made in this challenge.

Classify Mars Rover Images

Latest submissions

No submissions made in this challenge.

Detect Space Debris

Latest submissions

See All
failed 126803

Fix Corrupted Mars Images

Latest submissions

See All
graded 128820

Latest submissions

No submissions made in this challenge.

Recognize F1 Car Speed

Latest submissions

See All
failed 128428
failed 128347

Remove Smoke from Image

Latest submissions

See All
graded 128433
failed 128362
failed 128356

Classify Rotation of F1 Cars

Latest submissions

See All
graded 128964
graded 128837

Classifying Emotion from Texts

Latest submissions

See All
graded 141250
graded 136610
failed 136609

Can you classify Research Papers into different categories ?

Latest submissions

See All
failed 141310
failed 141307
failed 141306

Deshuffle the Shuffled Text

Latest submissions

No submissions made in this challenge.

Feature Engineering in Texts

Latest submissions

See All
graded 146672
failed 146669
failed 146667

Predict Text from Sound

Latest submissions

See All
graded 149018
graded 148506
graded 147406

Latest submissions

See All
failed 150449

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Segmenting trees from an aerial images

Latest submissions

See All
graded 149736

Can you dock a spacecraft to ISS ?

Latest submissions

See All
failed 152094

Can you detect Starship with unsupervised data ?

Latest submissions

No submissions made in this challenge.

Can you detect Icebergs in low visibility ?

Latest submissions

No submissions made in this challenge.

Can you remove clouds from an high altitude videos ?

Latest submissions

No submissions made in this challenge.

Can You Classify the Weather from the Images

Latest submissions

No submissions made in this challenge.

Semantic Segmentation of Self Driving Car Environment

Latest submissions

No submissions made in this challenge.

Predict Obstacles Around Self-Driving Cars

Latest submissions

No submissions made in this challenge.

Multi-Class Object Detection on Road Scene Images

Latest submissions

No submissions made in this challenge.

Can You Detect Cars Around You Using LiDAR Data?

Latest submissions

No submissions made in this challenge.
Gold 0
Silver 0
Bronze 0

Badges


  • May 16, 2020

  • May 16, 2020
Participant Rating
vrv
rdeggau 133
Participant Rating
mohanty
Shubhamaicrowd has not joined any teams yet...

Object Detection

Two questions to the " [Getting Started Notebook] Object Detection"

About 1 month ago

Hi, it’s fixed now!

For the -

  1. Why score = 0 & Why " Generating Predictions" has the variable ‘n’ in two for-cycles ?

I looked into the issue and turns out there were few mistakes we made in our baselines such as -

  • Not loading the model weights after training it.
    cfg.MODEL.WEIGHTS = os.path.join(cfg.OUTPUT_DIR, "model_final.pth")

  • Bounding boxes were in the wrong format
    The right format for bounding boxes is (x, y, w, h) instead of (x1, y1, x2, y2) ( which detectron2 outputted )

As for the -

  1. and “image_id”:n+1?

The image_id helps the evaluator identify predictions for each image. So there are 1000 unique images ids because there are 1000 testing images.

To know what is the image_id of each image, it is simply the file number ( for ex. 345 in 345.jpg ) + 1 because the image_id starts from 1 in our ground truth file.

I hope this helps, the getting started notebook is also updated! let me know if you still had any doubts :slight_smile:

Shubhamai

Two questions to the " [Getting Started Notebook] Object Detection"

About 1 month ago

Thanks for letting us know :slight_smile: I am looking into the notebook and will give you updates asap

Obstacle Prediction

505 Error everytime i open leaderboards

About 1 month ago

Hi, it should be working now :rocket:

505 Error everytime i open leaderboards

About 1 month ago

Thanks for letting us know! We are looking into the issue

AI Blitz X

Submission Guidelines

2 months ago

Yes, you can make submissions from your own/local machine, but the submission has to be a .ipynb notebook. In case you want to import a custom python file, you can add that python file in the assets directory and then import it in the .ipynb notebook. I hope this helps :), let me know if you have any doubts!

Cheers
Shubhamai

Submission issue on google cloud platform

2 months ago

Hi, can you please tell which specific puzzle you are having issues with ? We are looking into the issue however an another way you can make the submission is by wrapping up all necessary files in a zip file such such that the zip file contents tree looks something like this -
Using Docking ISS puzzle as an example

submission.zip
├── assets
│   └── submission.csv
└── original_notebook.ipynb
  • The original_notebook.ipynb is the notebook you used to train & make the predictions.
  • The submisison.csv contains the predictions of the puzzle ( the format can be different for different puzzles ).

After that you can simply submit the zip file by running
aicrowd submission create -c docking-iss -f YOUR_ZIP_FILE_PATH

Submission Guidelines

3 months ago

Hi, everyone, in this post we wanted to clear up some doubts and also mention some common errors that participants were making in the 4th challenge of AIcrowd Blitz X.

Evaluation Systems

With the AIcrowd Blitz X Challenge 4 ( Iceberg Detection ), our goal was to implement semantic segmentation models that can run in very low compute devices such as Raspberry PI, etc. So that’s in why in this challenge 4, the server that evaluates the notebook are equipped with 1 CPU and 2 GB RAM.

Your goal will be to build models that can work with as much accurately as possible with still doing inference in a very limited amount of computing and time.

Common Errors/Mistakes

And here are some common errors

  1. The markdown text such as Install packages, Define Preprocessing code, Prediction phase is used by our evaluation server to identify the part of notebook run as per the rules of the challenge. These should not be removed or altered.

  2. Evaluation timed out. View the submission for more details.
    This is due to your submission taking too much time to make predictions, make sure your code doesn’t take more than 15 minutes to make predictions.

  3. Inference failed. View the submission for more details.
    There can be many reasons for this error, are are most commons

    1. Participants uploading too big submission files, which filled up memory completely in our evaluation systems and caused the error. While we have increased the memory on our systems, make sure your submission never goes above 500 MB.

    2. Make sure the FFmepeg is installed and configured in your submitted notebook, ffmpeg is used by scikit-video for wring the output video predictions.

    # Installing Scikit Video & FFMPEG
    !pip install scikit-video
    !pip install ffmpeg
    !apt-get install ffmpeg gstreamer1.0-libav vlc
    !apt-get update -qq && sudo apt-get -y install \
      autoconf \
      automake \
      build-essential \
      cmake \
      git-core \
      libass-dev \
      libfreetype6-dev \
      libgnutls28-dev \
      libsdl2-dev \
      libtool \
      libva-dev \
      libvdpau-dev \
      libvorbis-dev \
      libxcb1-dev \
      libxcb-shm0-dev \
      libxcb-xfixes0-dev \
      meson \
      ninja-build \
      pkg-config \
      texinfo \
      wget \
      yasm \
      zlib1g-dev
    !apt-get install ffmpeg libsm6  libxext6 -y
    !pip install sk-video p-tqdm
    !apt-get update
    !apt-get install -y python3-opencv
    !pip install --upgrade opencv
    !pip install --upgrade torch torchvision
    

Tips

  • If you are using a custom model, make sure you always save your model in the assets directory in Training Phrase markdown section & read the model from the assets directory in Prediction phrase markdown section.

If you are using Colab, you probably won’t need to zip folder as aicrowd-cli takes care of that :slight_smile: using
!aicrowd -v notebook submit --assets-dir assets --challenge iceberg-detection

Cheers

Shubhamai

PS : If you have any issues or doubts, feel free to reply to this post.

About Leaderbords

3 months ago

We found the issue and made the fix. The evaluator in Tree Segmentation & Iceberg Detection were using Dice Coefficient so I have updated the readme & leaderboard & Clouds Removal leaderboard is also resorted. Thanks for noticing & letting up know :slight_smile:

Shubhamai

Evaluation timed out waiting for submission data. View the submission for more details

3 months ago

We are looking into the issue and will give you updates asap. Can you try making the same submission again and see if that works ?

Starship Detection-ca47bb

0 score but submission evaluated

2 months ago

I tried looking into the issue and also re-runned the submission but I couldn’t able to find anything wrong from our side, can you please check and see if the bounding boxes were in the right format (x, y, w, h) or the ImageID corresponding to bounding box is correct.

Shubhamai

Why I get SyntaxError: invalid syntax (, line 1) in submission

3 months ago

It was due to because you didn’t had any commas in each list of the bbox column in your submission.csv file. such as
[1 1 1 1] instead of [1, 1, 1, 1] .

To fix this, you can simply add python list as a new column in pandas. Such as below code from Getting Started Notebook.
df = pd.DataFrame({"ImageID":image_ids, "bbox":bboxes})
Where bboxes is a nested list containing the bounding boxes in x, y, w, h format.

I hope this helps :slight_smile: . Let me know if you still have any doubts!

Shubhamai

Docking ISS-d5b4fb

ISS Docking leaderboard

3 months ago

The same question was also replied in discord too but i will also send it here in case another participant also had the same question :slight_smile:

Yep, so the Distance Loss is mainly taken into account, but in case, there was a same score in Distance Loss, the second Docking Port Loss is taken into account.

Iceberg Detection

Submission failed

3 months ago

Sorry for a little late reply but I looked into the notebook & the output .mp4 predictions, and found out that the videos the gen_predictions function is outputting contains only single frame.

And it’s because the predictions variable, from the model.nn_module.predict(image_batch) in gen_predictions function, has shape torch.Size([1, 1, 128, 128]) which represents a single image, the image_batch variable has also the same shape.

So i find out the main reason for this error is because you changed the batch size of test_loader from 23 ( in getting started code ) to 1. The main reason of using batch size of 23 in getting started code was because that each batch will represent each video.:slight_smile: So, you will change to change your batch size to 23 and hopefully it will all work.

Let me surely know if you have any more doubts.

Cheers
Shubhamai

Submission failed

3 months ago

We are looking into the issue, I will give you updates as soon as possible :slight_smile:

Submission failed

3 months ago

it isn’t working. please try to submit your contribution code.

Can you please share what exact error are you getting in the colab notebook while running ?

now, what is it?

While there could be multiple reason of it, It was most certainly due to your model was taking more than 10 minutes to make the predictions, please make sure your model while using only CPU makes predictions within 5-10 minutes!

Shubhamai

Submission failed

3 months ago

It’s fixed and should be working now. Thanks for letting us know :slight_smile:

Shubhamai

Clouds Removal

Suggestions concerning how to solve this puzzle

3 months ago

Hi, the dataset is actually paired :slight_smile: So you can use pix2pix!

AI Blitz #9

I do not understand the metrics defining leaderboard

4 months ago

Hi, It is due to one of your previous submissions has a score of 0.561 which is lower than 1.0. In order to change the leaderboard, you have to get a score that is lower than your current lowest score.

Also we are using word error rate as our evaluation metric for this competition, in which the lower the score is, the better.

I hope this helps :slight_smile:

Shubhamai

NLP Feature Engineering-9be8f9

Common Mistakes and Tips

4 months ago

Thanks a lot for the feedback :slightly_smiling_face:

The notebook provided for this comp has way more things than the minimal for people make submission and it was great for learning purposes, but for a “sample submission” purpose it was not ideal. Maybe make two the next time? One as simple as possible, showing just the requirements and instructions, and then one more detailed and more advanced?

I actually really liked the idea, we will make sure in the future to put a minimal required submission notebook in the challenge.

I tried the same code with a new model having only different weights and it failed. Also the log provided by the platform also does not help.

Yep, This is something that we are actively working on will make sure to have better & informative logs from the next blitz.

Cheers
Shubhamai

Shubhamaicrowd has not provided any information yet.

Notebooks

Create Notebook