shivam

Leaderboard BUG (Lost my submissions and place)

Hi @toefL,

It has been fixed.
There was a delay in your rank update after creating the team.

View post 1

Submission

Hi @harshita_gupta,

Can you share the page on which the message is coming for you?

We can check it out accordingly.

View post 1

MSE score of 0.0

Hi everyone,

Here is update on the issue:

View post 0

🚨 Update in Test Dataset | 📥 Reminder to Download

View post 0

Who else got a call from Ali?

View post 1

Announcing a bonus round while you wait!

Hi @RHG,

Nice catch!
Bonus Round’s RMSE was indeed wrongly sorted and has been fixed now.

Congratulations on claiming the first rank , while other participants brace themselves to attack for the 1st position

View post 3

Market Simulation - what happens next?

Hi @kamil_singh,

You can check the full description on the next steps here:

View post 3

Evaluation failed

Hi @sweet_bitter,

You need to remove global_imports from your packages list.
It should work after it.

View post 0

R package "caret" cannot be installed

Hi @FrankSchmid,

It looks like you need to install it along with it’s dependencies (either via dependencies=TRUE or listing them seperately).

install.packages('caret', dependencies=TRUE)

or

install.packages('caret', dependencies=c('ddalpha', 'recipes'))

Source: https://stackoverflow.com/a/46176104

View post 2

Will my code run on the AI Server?

Hi @kamil_singh, can you provide the submission ID in which you attempted it? We can suggest accordingly.

View post 2

ERROR: No matching distribution found for os

Hi @tom_snowdon,

The os package is part of Python’s standard library (pre-installed) and you don’t need to specify in your requirements.txt.

View post 3

Hello! I'm new here, could I attend the challenge with my own team without others?

Hi @Lin_Yan_Liang,

Welcome to AIcrowd.

You can participate in the challenge as an individual, and creating a team isn’t a requirement.

This challenge consists of three tasks which are:

Once you open any task, you will be able to make a submission for the same.

We also have getting started code and baseline code available in the notebooks section for you to get started.

https://www.aicrowd.com/challenges/multi-agent-behavior-representation-modeling-measurement-and-applications/notebooks

Happy solving!

View post 0

Colab for this competition

Hi @ibrahim_sherif,

I did a quick implementation and this might be the end to end example you are looking for.

Please note, that I only worried about dataset integration on Colab/Notebook via CLI in this example, and have not done end to end testing of baseline.

The baseline need some love, and you can even share your fixed/better version in the Notebook sections!
I am pretty sure other participants might be interested in the same too.

View post 2

Colab for this competition

Hi @ibrahim_sherif,

Yes, AIcrowd supports dataset download via cli.
You can download the dataset on the Colab/Notebooks using the same.

I have added an example notebook here:

You can also click on “Open in Colab” button to get started right away!
Let us know in case you face any difficulties.

Cheers,
Shivam

View post 3

Flatland Submission Failure

Hi @student & @mitesh_mutha,

Thanks a lot for reporting the issue.

It was an issue on our side. It is now fixed and your submission(s) have started. Sorry for the inconvenience caused.

View post 0

Learning New Behavior | Multi-Agent Behavior Challenge

View post 0

Annotation Style Transfer | Multi-Agent Behavior Challenge

View post 0

Classical Classification | Multi-Agent Behavior Challenge

View post 0

How to run evaluation locally?

The challenge has officially ended few months back.

But in case you are interested in playing with the problem you can run end to end submission on your local environment.

In order to run the starter kit locally for getting scores w.r.t. leaderboard you can do the following:

result, detailed_scores = real_robots.evaluate(
                SubmittedPolicy,
                intrinsic_timesteps=0,
                extrinsic_timesteps=10000,
                extrinsic_trials=50,
                visualize=False,
                goals_dataset_path=DATASET_PATH
            )

in your local_evaluation.py.

The scores will be comparable to the one on the leaderboards.
Let us know in case any more help is required!

Cheers,
Shivam

View post 1

Winner Announcement during AI and Gaming Research Summit

View post 0