Loading
0 Follower
0 Following
no_name_no_data

Location

JP

Badges

4
2
1

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Small Object Detection and Classification

Latest submissions

See All
graded 236293

Latest submissions

See All
graded 197335
graded 197333

Machine Learning for detection of early onset of Alzheimers

Latest submissions

See All
graded 145430
graded 145407
graded 145403

5 Puzzles 21 Days. Can you solve it all?

Latest submissions

See All
graded 156756
graded 156746
Participant Rating
Participant Rating
no_name_no_data has not joined any teams yet...

ADDI Alzheimers Detection Challenge

Submission Duration

Over 2 years ago

I have the same problem. I also want to know how to deal with it.

👋 Welcome to the ADDI Alzheimer's Detection Challenge!

Over 2 years ago

@ashivani
I agree with @konstantin_nikolayev. I think it is better to evaluate the submissions by more precise log loss score instead of rounded one.
In this competition, to improve the log loss by 0.000x (it may be ignored if rounded to the 3rd decimal) requires some effort.
if scores are rounded, it is more likely that the difference between better solution and others is just when it is created rather than what it is.
Though 0.000x improvement may not be so important for practical use, I think it is better to take the difference into consideration to make this competition fair.

👋 Welcome to the ADDI Alzheimer's Detection Challenge!

Over 2 years ago

@ashivani,
Thank you for your reply.
It seems that the leaderboard has changed, but the order may still not be correct. (for example, there are 3 teams in rank#3, and the team that has the second highest score and submitted the earliest is placed at the bottom among them.)
Is it still being fixed?

Is it really ok to consider all submissions? if so, I think a solution that just happen to overfit the test dataset is more likely to be selected as the best.

👋 Welcome to the ADDI Alzheimer's Detection Challenge!

Over 2 years ago

@vrv,
how are the submissions sorted on the Leaderboard? I think they are sorted only based on the log-loss score. But now(5/8 13:35 UTC) on the Leaderboard, it seems that #1 public log-loss score is 0.60837 and #2 is 0.60834. These submissions are tie if they are rounded on 3 decimal place, however, #2 was submitted earlier than #1. Is that an expected behavior of the Leaderboard?

in addition, do we need to select the final submission that is evaluated on the private leaderboard? or all submissions will be included on the private leaderboard?

i’m sorry if this is not appropriate place where we ask questions to competition admins.

no_name_no_data has not provided any information yet.