Occurance for "Evaluation timed out 😢" in validation phases

Thank you for the detailed explanation! I now have a better understanding of the process flow.

I’ve been trying to follow the process you described, and now I’m getting successful submittals that I couldn’t get through before.

View post 0

Occurance for "Evaluation timed out 😢" in validation phases

Since timeouts occur frequently at validation timing, I would like to ask the following two questions.

The first question is whether different tracks have different validation timeouts.

The following three are submits of the same code to Tracks 1, 2, and 3, with Tracks 1 and 2 succeeding to the end. Track 3, on the other hand, fails with a validation timeout error every time, even after multiple submissions.

Is this because different tracks have different time limits allowed for validation?

• AIcrowd
• AIcrowd
• AIcrowd

The second question is, do the timeouts during validation occur during model loading, or is it because the inference is too slow for the sample data?

If it occurs during model loading, I don’t understand why it succeeds or fails depending on Track.

If the timeout occurs because inference is too slow, we would like to know how many seconds or more it takes to process one piece of data to cause an error.

View post 2

Up to two or five submissions per week?

Are submissions limited to two per week for the entire duration of the competition?
Or is the limit of two submissions the initial one or two week limit and then up to five?

The Rules page includes the following statement:

A Team may make only five submission per task per 7-day period. If a Team makes more than five submission per task per 7-day period, only the first five submission per task will be evaluated.

The Overview page includes the following statements:

• Each team will be able to make up to 2 submissions per week for each track in tracks 1-4, and 1 Track 5 all-around submissions per week.

(March 25th, 2024) Finally, after an arduous testing, we are ready to receive GPU submission to Tracks 1-5! As a warmup period, in the first 1-2 weeks, we would apply a tight submission limit.

• For Tracks 1-4, each team can make 2 submissions per week per track.
• For Track 5 All-around, each team can make 1 submission per week.

View post 0

👋 Welcome to Amazon KDD Cup '22!

Is there a deadline to create or join a team, can it be until the last minute on 7/15?
One more thing, there is a limit of 5 submissions per day, but what happens if we team up with people who have already submitted 5 times?

View post 0