When does the second phase open?

Yeah, Leaderboard C is showing the lowest scores of each team and also sorted backwards.

View post 3

Feedback and suggestion

I’ve been submitting a lot lately and it seems that identical submissions can have very different evaluation throughputs.
I submitted the same model (same architecture with different model weights) 5 times and got throughputs that vary from 0.007 ts/s ~ 0.019 ts/s.

Is this something that can be fixed? I’m pretty sure it wasn’t like this in MDX 2021.

View post 2

Timeout limit not increased yet?

Round2 is supposed to have increased timeout limits but I’m having trouble submitting larger models.
I’m not very sure but I have a feeling that the limit is not updated yet. Could you guys please check up on this?

View post 2

No space left on device

My recent submissions are getting “No space left on device” during the build image phase.
They are similar in size compared to my old submissions so I’m guessing this is a server side issue?

View post 1

Submission stuck at 9% evaluation

(post withdrawn by author, will be automatically deleted in 24 hours unless flagged)

View post 0

Failed at "Build Image" with no logs

My recent submission #145473 failed without giving any “docker-image-build” logs (just a blank page).
What might have caused this?

View post 2

What might cause a "Scoring failed"?

Yeah I noticed too. My submissions also doesn’t exceed 240s so i really don’t know what the problem is.

View post 2

What might cause a "Scoring failed"?

I’ve been getting the “scoring failed” error as well. All my submissions have failed with that same error since they added the extra song for early timeout checking.

View post 3

External datasets

The current leaderboard seems to show all submissions regardless whether external datasets were used or not. Is there a way to view leaderboards A and B separately?

View post 3