mohanty

What's the etiquette on sharing code?

Hi @simon_coulombe,

We highly encourage participants to share their code.
Please feel free to create a separate repository or a google colab notebook and share the link here on the forums.

I believe @shivam and team had also been working on a better way to share code more natively on the platform.

Best,
Mohanty

View post 3

Tips on creating a successful submission

@jyotish: Can we basically have a custom base image where all the common dependencies are already installed ?
It will hopefully both reduce the image build times and also help us avoid back and forth many such dependency related issues.

View post 2

Build failure for custom conda environment. Frustrating and time consuming to debug the build failures

Hi @mario_lovric,

I am sorry about the hurdles in packaging your software environment. Have you managed to write a Dockerfile which can do the predictions at your end ?
Someone from our team would anyway reach out to assist you in the process.

Best,
Mohanty

View post 0

Build failure for custom conda environment. Frustrating and time consuming to debug the build failures

@justmahesh: The need for code based submissions is to allow us to evaluate your models on test sets that cannot be released publicly because of legal constraints. And the need for submitting code does add a barrier to entry which we acknowledge, and we are willing to assist all the participants in packaging their code for making a valid submissions.

We will follow up on this particular issue, but we also have office hours (@jyotish : can you please share details) to help all the participants on a one on one basis.

Best,
Mohanty

View post 0

Questions about leaderboard / private set

@ktverdov: This round of the food benchmark does not have a separate validation set, and hence the scores on the leaderboard are the final scores for this round. We release new test sets at the end of each round. In the subsequent rounds we will ensure to have separate public and private scores.

The recall score will be used as a tie breaker. So if two submissions have the exact same (upto 3 decimal points) precision then their order will be determined by the recall scores.

Best,
Mohanty

View post 2