Are you still going to use 10 predictions for MRR? I think I saw this in the earlier version of the description but can’t find it anymore. Sorry if I misunderstood.
Here you say May 5th and in the challenge description is changed to June 5th. What is correct
Will you be giving some baseline?
As title says. I would appreciate if organizers comment on this…
thanks, kudos to you too. See you at the next stage, I assume.
thank you. Looking forward to it.
Best of luck to all and see you on the next challenge
Congrats to all. It’s been 3 days since the competition finished and we haven’t got any info how we shall proceed from here. What happens next @devops?
@amapic stay tuned for stage 4
How come some of my subs took 14h and didn’t fail if the limit is 8h? Then again, how am I supposed to know that timeout is set to 8h? Where is it written? I also thought for a moment that you keep changing the timeout limit? Can you confirm that this is not true?
inferencing time is way off. Locally my model on 1080ti takes ~10 minutes to execute so obviously it runs on CPU when submitted.
@devops @shivam what does the timeout mean? Anyone knows where I can find this information. I have asked this question numerous times after @devops commented my failed subs but they were ignored so I am bring it up here.
How am I supposed to debug Timeout? Some of my successful subs took longer to execute than most of those which failed because of timeout. I couldn’t come up with reasonable explanation for such behaviour. I hope you can help me to understand this.
I apologize for overlooking this. Slow evaluation drove me crazy as I mentioned earlier in this discussion.
Now I wonder how I am supposed to know this?
Am I supposed to read through previous competitions to understand how to submit?
Also I really think you should add edit history for your challenge description? Two months ago I read it for this challenge and now I see it’s changed. Nothing important, you updated number of images which were originally just copy pasted from stage 2. I hope you will not take my comments as an offense, I am just trying to understand, share my experience and give some suggestions how to make it easier to participate.
do not change the default
just exported yml with conda. train locally and inference in docker
frustration is the word that describes my participation in this challenge. I spent around 1h to build the actual model but days to make a successful submission. Participation should definitely be more straightforward. A must is to enable “debug” with instant error logs. Besides