Loading
15 Follower
29 Following
shivam
Shivam Khandelwal

Organization

AIcrowd

Location

Gurgaon, IN

Badges

11
7
4

Connect

Activity

Jul
Aug
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Latest submissions

See All
graded 191712
graded 191710
graded 191708

Behavioral Representation Learning from Animal Poses.

Latest submissions

See All
graded 179081
graded 173187
graded 173085

Latest submissions

See All
graded 180080
graded 180079

A benchmark for image-based food recognition

Latest submissions

See All
failed 177330
graded 177329
graded 177328

What data should you label to get the most value for your money?

Latest submissions

See All
graded 177046
failed 176542
failed 176404

Improving the HTR output of Greek papyri and Byzantine manuscripts

Latest submissions

See All
graded 188253
graded 188252
graded 188221

ASCII-rendered single-player dungeon crawl game

Latest submissions

See All
submitted 158196
failed 158192
failed 158191

Latest submissions

See All
graded 158774
graded 147099
graded 141760

Airborne Object Tracking Challenge

Latest submissions

See All
graded 150618
graded 148372
graded 145797

Latest submissions

See All
graded 165005
graded 165004
graded 164936

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Machine Learning for detection of early onset of Alzheimers

Latest submissions

No submissions made in this challenge.

Sample Efficient Reinforcement Learning in Minecraft

Latest submissions

See All
graded 150880
failed 149894
failed 149002

Latest submissions

See All
graded 167201

Measure sample efficiency and generalization in reinforcement learning using procedurally generated environments

Latest submissions

No submissions made in this challenge.

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Self-driving RL on DeepRacer cars - From simulation to real world

Latest submissions

No submissions made in this challenge.

Robustness and teamwork in a massively multiagent environment

Latest submissions

No submissions made in this challenge.

3D Seismic Image Interpretation by Machine Learning

Latest submissions

See All
graded 82746
graded 82738
graded 82737

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 149881
submitted 149879
failed 144887

Play in a realistic insurance market, compete for profit!

Latest submissions

See All
graded 113613
graded 110174
graded 110172

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Multi-Agent Reinforcement Learning on Trains

Latest submissions

See All
failed 84106
failed 84105
failed 84104

A dataset and open-ended challenge for music recommendation research

Latest submissions

No submissions made in this challenge.

A benchmark for image-based food recognition

Latest submissions

See All
graded 59791
failed 59371
failed 31084

Latest submissions

See All
graded 139559
graded 139558
graded 139557

Sample-efficient reinforcement learning in Minecraft

Latest submissions

See All
graded 120070
graded 117123
graded 113473

Latest submissions

See All
graded 125603
graded 125602
graded 125601

5 Puzzles, 3 Weeks. Can you solve them all? 😉

Latest submissions

No submissions made in this challenge.

Multi-agent RL in game environment. Train your Derklings, creatures with a neural network brain, to fight for you!

Latest submissions

No submissions made in this challenge.

Predicting smell of molecular compounds

Latest submissions

See All
failed 114224
failed 114223
failed 114222

Latest submissions

See All
graded 60335
graded 60334

Latest submissions

See All
failed 68839
failed 68599

5 Problems 21 Days. Can you solve it all?

Latest submissions

See All
failed 122822

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Robots that learn to interact with the environment autonomously

Latest submissions

See All
graded 99115
graded 99114
failed 99109

5 Puzzles, 3 Weeks | Can you solve them all?

Latest submissions

See All
graded 115551
graded 115537
graded 115536

5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Grouping/Sorting players into their respective teams

Latest submissions

No submissions made in this challenge.

5 Problems 15 Days. Can you solve it all?

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Sample-efficient reinforcement learning in Minecraft

Latest submissions

No submissions made in this challenge.

Multi Agent Reinforcement Learning on Trains.

Latest submissions

No submissions made in this challenge.

Recognise Handwritten Digits

Latest submissions

See All
graded 191700
graded 191699
graded 191698

Online News Prediction

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

5 Problems 15 Days. Can you solve it all?

Latest submissions

See All
graded 67402
graded 66492

Project 2: Road extraction from satellite images

Latest submissions

No submissions made in this challenge.

Project 2: build our own recommender system, and test its performance

Latest submissions

No submissions made in this challenge.

Project 2: build our own text classifier system, and test its performance.

Latest submissions

No submissions made in this challenge.

Help improve humanitarian crisis response through better NLP modeling

Latest submissions

See All
failed 32245

Reincarnation of personal data entities in unstructured data sets

Latest submissions

No submissions made in this challenge.

Robots that learn to interact with the environment autonomously

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning

Latest submissions

No submissions made in this challenge.

Predict if users will skip or listen to the music they're streamed

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

PlantVillage is built on the premise that all knowledge that helps people grow food should be openly accessible to anyone on the planet.

Latest submissions

No submissions made in this challenge.

Predict Labor Class

Latest submissions

See All
graded 68597

5 PROBLEMS 3 WEEKS. CAN YOU SOLVE THEM ALL?

Latest submissions

See All
failed 85240

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Real Time Mask Detection

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 80051

Predict if users will skip or listen to the music they're streamed

Latest submissions

No submissions made in this challenge.

Recognizing bird sounds in monophone soundscapes

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Predict Wine Quality

Latest submissions

No submissions made in this challenge.

Predict if an online advertisement will be clicked or not

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Detect water bodies from satellite Imagery

Latest submissions

See All
failed 85240

DA Final Project challenges for Monsoon 2020

Latest submissions

No submissions made in this challenge.

ACL-BioNLP Shared Task

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Identify which side has least players

Latest submissions

No submissions made in this challenge.

Predict viewer reactions from a large-scale video dataset!

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Detect Multi-Animal Behaviors from a large, hand-labeled dataset.

Latest submissions

See All
failed 125036

Reinforcement Learning, IIT-M, assignment 1

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 177209

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
failed 149894
failed 149002

Can you dock a spacecraft to ISS ?

Latest submissions

No submissions made in this challenge.

Multi-Agent Reinforcement Learning on Trains

Latest submissions

See All
graded 152700

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Image-based plant identification at global scale

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Round 1 - Completed

Latest submissions

See All
graded 173085

Localization, SLAM, Place Recognition, Visual Navigation, Loop Closure Detection

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Predict Age From A Picture

Latest submissions

See All
failed 182084

Identify Words from silent video inputs.

Latest submissions

See All
graded 182202
failed 182087

Round 2 - Active | Claim AWS Credits by beating the baseline

Latest submissions

See All
graded 179081

A Challenge on Continual Learning using Real-World Imagery

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.
Participant Rating
krishna_kaushik 0
cadabullos 0
jerome_patel 0
amitabh 0
singstad90 0
vrv
jyotish
deepesh_grover 0
leocd 0
ashivani
ayush_upadhyay 0
sanjaypokkali 221
rohitmidha23 265
anssi 221
thomas_cloarec 0
Participant Rating
jyotish
michael_schmuker 0
dmytro_poplavskiy 0
michael_bordeleau 0
leocd 0
ashivani
vrv
shubhankar.sb 0
kartik.gupta0204 0
shubham_sharma 0
rohitmidha23 265
nickinack 0
sanjaypokkali 221
aditya_morolia 0
shraddhaa_mohan 272
hagrid67 103
yoogottamk
piotrekpasciak 0
akhilesh 0
akshatcx -39
pulkit_gera 0
sauravkar 0
nikhil_rayaprolu 190
user18081971 0
marcel
mohanty
MasterScrat 229
anssi 221
aicrowd-bot

ESCI Challenge for Improving Product Search

Is there a limit on the total number of submissions when merging teams?

About 20 hours ago

Hi @good-good-study, yes, it is 5 submissions/task/day.

We have just resetted the submission limit due to issue with code submissions earlier which should solve the wrong counting. Please let us know incase you still face any issues.

Predicition submission

About 21 hours ago

Hi @wxl121228, yes the prediction submissions are closed right now in favour of code submissions round.

More info about the code submission round:

🚀 Code Submission Round Launched 🚀

About 21 hours ago

Hi @amiruddin_nagri, the default leaderboard is “Code Submissions” which starter recently.

You can select “Prediction Submissions” to view the previous submissions and their relevant scores.

🚀 Code Submission Round Launched 🚀

Yesterday

Hi @wufanyou,

The absolute file paths are available as parameters of predict function.
(to get rid of any confusion participants may face with directory structures)

We have data, models, etc folders available as examples for the getting started section and a better local development experience. You are free to upload your models and relevant files in folder/structure of your choice. The only constraint is that the entrypoint to your code evaluations will be run.py.

The idea to provide product catalogue by default sounds good. :+1:
Please let us check internally and we will update on the request soon.

🚀 Code Submission Round Launched 🚀

Yesterday

Hi @wufanyou,

Thanks for your questions.

The submission process is as follows :point_right:

The public test set phase is available for debugging purposes.
You can run your code end to end on the public split and the logs for this phase will be available, etc. The time taken in image building and public split stages, etc would not be counted towards your 30 minutes timeout (and have their own timeouts to avoid misuse).

The private split run however have 30 minutes purely reserved for your end to end run on the private dataset.


Yes, the default docker image is nvidia/cuda:10.1-cudnn7-runtime-ubuntu18.04, however you are not restricted to use that and can choose to use requirements.txt, environment.yml to even custom images & Dockerfile.
Please note, in case you are using your custom image, you need to make sure that they have relevant Nvidia drivers installed to make use of the GPU.

A full detail about the runtime is available in starter kit’s description as well as on Discourse here.


Please check more details in the starter kit’s README and let us know if you still have any follow up questions. :raised_hands:

Are there any way to modify the team name?

2 days ago

Hi @wufanyou,

Unfortunately you can’t modify the team name directly right now.

Please :email: drop a message with your previous & new team name.
We will get it changed shortly!

Is there a limit on the total number of submissions when merging teams?

4 days ago

Hi @heya5,

This challenge has daily submissions limit of 5 submissions/day/task/team.

While I understand the reason behind submission * total_day condition for team merging on other platforms.
We do not have this check currently for this challenge.

Please note, that, to tackle above issue, we generally have team freeze deadline after which new team members or teams can’t be created. It is on July 1, 2022 for this challenge.

Best,
Shivam

🚀 Dataset Update: `v0.3` of the dataset has been released 🚀

9 days ago

Hi @trenusch, please verify example_id column in your submission.
It looks like you are using indices [0....n] instead of the the example_id which are required for a valid submission, due to which your submissions are failing.

You can check sample submission for the correct example_ids as well.

🚀 Dataset Update: `v0.3` of the dataset has been released 🚀

9 days ago

Hi @trenusch,

The new test dataset files are already available on the resources page along with this announcement.

The new submissions since the release have the scores calculated on the new dataset (along with older submissions re-evaluated automatically).

We will start accepting the code submissions from 21st of June, 2022, until then you can continue submitting your predictions on the v0.2 test sets. However, the evaluators will only consider the subset of the test set which are present in the v0.3 of the test sets.

Please let us know in case you are still facing some issue in accessing or submitting solution on new Task 3 dataset.

🚀 Dataset Update: `v0.3` of the dataset has been released 🚀

11 days ago

Yes, you can use it for training.

Spotify Million Playlist Dataset Challenge

Any chance to use the dataset for my thesis?

4 days ago

Hi @rivima

Please check this response

Which is the deadline?

About 1 month ago

Hi, there is no deadline.
It’s an always running benchmark.

HTREC 2022

No way to load SequenceTagger

19 days ago

Hi @Bonum, here is an working example [should work on Colab] on how to use SequenceTagger:
https://www.aicrowd.com/showcase/sequencetagger-example

Yup, the files are missing in GitHub repository, while available in HF, so I have just merged them both to make it work. :man_shrugging:

All the best !

No way to load SequenceTagger

19 days ago

Hi @Bonum, the notebook has following example:

from transformers import AutoTokenizer, AutoModel
tokeniser = AutoTokenizer.from_pretrained("pranaydeeps/Ancient-Greek-BERT")
model = AutoModel.from_pretrained("pranaydeeps/Ancient-Greek-BERT")  

These models are hosted on HF due to which will work directly.


While you are trying to use SuperPeitho-FLAIR-v2/final-model.pt which isn’t, as the author told in the README.

We provide a pre-trained POS Tagging model in the directory SuperPeitho-FLAIR-v2

That means, you need to clone the main repository and use the model file directly.

$> git clone git@github.com:pranaydeeps/Ancient-Greek-BERT.git
$> cd Ancient-Greek-BERT

[...]
## run your python code along with above load command

All the best ! :wave:

Food Recognition Benchmark 2022

Local Run Produces Different AP

About 2 months ago

Hi all,

Thanks for opening this discussion, and it is indeed an important one.
I am happy that we all can brainstorm and improve the pipeline for all the participants together. :muscle:

The scores calculated right now we’re using the complete annotation files as @Mykola_Lavreniuk suspected, while the predictions made by your codebases get added for the calculation purposes on the go. The intention has always been to provide real-time feedback to you to show the approximate scores as soon as possible.


Issue #1: Score gradually increases

The flaw
We run COCOEval using complete annotations BUT with the subset of images (predictions generated ones), due to which the score starts with a much lower value and grows to your final scores.

Future update
We will be making an update in the pipeline based on this thread to create a subset of annotations file dynamically, calculate the scores with that for live reporting.


Issue #2: Validation scores don’t make sense

The flaw
We were using only 100 images in the validation phase because it worked as an integration test. We missed providing a proper scores table for the validation phase that you can use to compare local v/s online performance – which is our bad. The scores get calculated with annotation files for the complete validation subset, but only 100 images are present in the validation phase (as in Issue #1), causing much lower scores.

Future update
We will continue use a tiny subset to limit the compute used in validation phase and believe the score on 100 images should be reliable enough to compare local v/s online scoring. The list of these ~100 images will be shared in the resources section in future so you can reproduce the scores locally. (meanwhile the current scores were quite low, example 0.09AP while full evaluation for a lot more, it was happening due to Issue #1)

End of Round 2⏱️

About 2 months ago

Round 2 of Food Recognition Benchmark has ended !! :rocket:

This round saw a lot more activity and a lot more rank swaps on the leaderboard.
Thanks to you all for making it a success. :raised_hands:

While a few of submissions are being re-evaluated at the moment, the public leaderboard looks like this right now:

The number of participants who crossed the official baseline has increased from 12 to 15.
At the same time, participants having score >= 0.200 AP is increased from 6 to 11 as well! :partying_face:

We can’t wait to complete the due diligence before making the winners’ announcement.
Stay tuned for it! :loudspeaker:


Why Food Recognition Benchmark matters?

It’s a good time to re-share about exciting updates on how the community collaboration has worked so far and what it’s enabling! [Blog Post]

The Food Recognition Benchmark is not a competition, but an ongoing collaboration with a community of inspiring individuals like yourself, to deliver the future of diet tracking in research cohorts around the world.


What can you do meanwhile?

:handshake: Start some interesting discussions with other challenge participants’ here on the Forums or on Discord Chat.
:wink: Share what worked and what didn’t during the competition. And maybe some interesting approaches you may want to try out in future?
:ear: Share any feedbacks you have for future Rounds either in this thread of here.
:speak_no_evil: Guess the winners in this thread

Gitlab seems to be down

About 2 months ago

Hi, it will be back up within 5 minutes.

ImageCLEF 2022 Caption - Caption Prediction

Submission deadline

About 2 months ago

It ends on 06 May 23:59 UTC.

shivam has not provided any information yet.

Notebooks

Create Notebook

Notebooks

Create Notebook