🏆 Meta CRAG Challenge 2025 Winners Announcement

Thank you for sharing the results.
I would appreciate it if you could let me know the following:

• Which team holds the rights for the paper submission and presentation?

It would be very helpful if you could share this point with us first.

View post 2

Regarding the re-execution of 289837 and 289855

@yilun_jin8
Would it be possible to rerun this task?
As it may affect our final submission, we would greatly appreciate your response on this matter.

View post 0

Regarding the re-execution of 289837 and 289855

@yilun_jin8
Since the only difference is in the parameters and other successful runs have the same setup, it should work.
Would it be possible to have it re-executed?
289872
289871
289855
289837

View post 0

Regarding the re-execution of 289837 and 289855

Jobs 289837 and 289855 terminated without throwing any errors, but were marked as failed.
Would it be possible to re-execute them?

Additional Note：
I assumed that each team is allowed up to 10 submissions per task per week — is that correct?
Some teams appear to have successfully submitted more than 10 times.

View post 0

Regarding human evaluation tendencies

If the following VQA question were given, would both of the following be considered correct, or only the first one?

Question:
“Are these small red onions a nutrient-rich food?”

Answer1:
“Pearl onions are a nutrient-rich food, providing vitamins C and B6, potassium, and manganese, which support overall health and well-being.”

Answer2:
“Small red onions are a nutrient-rich food.”

View post 0

The reason why submission 286895 failed

@jyotish @yilun_jin8 @Jiaqi
Excuse me, would you mind taking a look at this issue?
Unfortunately, we are unable to proceed with the competition because of this error.

View post 0

The reason why submission 286895 failed

The submission failed, so I clicked the “View” button to check the details.
However, it says “Logs are not available,” and I can’t see the reason for the error.
If possible, could you please let me know the cause of the failure?

Also, does this error count as one submission?

スクリーンショット 2025-06-05 6.08.582546×1112 234 KB

View post 0

Can we submit a stable solution to the competition?

@yilun_jin8
Sorry to jump in, but if possible, could the issue be addressed by increasing the number of allowed submissions instead of extending the deadline? Alternatively, could failed submissions be excluded from the submission count?

We have planned our schedule based on the originally set deadline, and repeated extensions may disadvantage at least some participants.

View post 0

Status was changed after submission

We believe that failures caused by changes in the API specification are outside our scope of responsibility. At the very least, the API interface should remain consistent before and after any updates.
Since we are participating in the competition while working full-time, it may be difficult for us to keep up with sudden API changes — which makes us a little sad.

We hope you will consider this to help make the competition even better.

View post 0

Regarding Image Resizing

I was reviewing the code and just wanted to double-check something.
Would the intended behavior perhaps be this?

if image_url is None:
    image = image.resize((960, 1280))

Instead of:

if image_url:
    image = image.resize((960, 1280))

Please let me know if I’m misunderstanding anything!

View post 1

Regarding Image Resizing

@jyotish @Chris_Deotte
Thank you very much for your prompt response and for updating the code.
I also understand now that the local and leaderboard evaluation scripts operate independently.
Thanks!

View post 0

Regarding Image Resizing

Looking at the revised code, it appears that the non-ego images are being resized. Shouldn’t the condition be the other way around?

View post 1

Question About Submission 286114 Error

I received an error on my Task 1 submission (submission_id: 286114) with the following message:

Gym server stopped unexpectedly. Please contact the admins. Check the submission page for more details.

Could you please help me understand the cause of this error?

Also, I would like to ask: if I want to use multiple fine-tuned models in my submission, is it possible to specify them via the aicrowd.json file on Hugging Face? If so, what is the correct format?

View post 0

Image Specifications and Their Implementation Introduced in Phase 2

We understand that the following condition has been newly added since the start of Phase 2:
Egocentric image evaluation now uses low resolution (960×1280); standard image resolution is unchanged.

However, when reviewing the code, it appears that all images are being resized. Could you please confirm if this is the case?
Also, regarding the batch_generate_response function of the agent, is it correct to assume that the input images are a mix of both (960×1280) and original resolutions?

View post 2