Loading
2 Follower
0 Following
aerdem4
Ahmet Erdem

Organization

Nvidia

Location

TR

Badges

2
0
0

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Challenge Categories

Loading...

Challenges Entered

Improve RAG with Real-World Benchmarks | KDD Cup 2025

Latest submissions

See All
failed 289567
graded 286855
graded 286821

Improve RAG with Real-World Benchmarks

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Machine Learning for detection of early onset of Alzheimers

Latest submissions

See All
graded 134437
graded 134394
graded 134384

Recognizing bird sounds in monophone soundscapes

Latest submissions

No submissions made in this challenge.

Generating answers using image-linked data

Latest submissions

See All
graded 286855
graded 286821
failed 286800

Synthesising answers from image and web sources

Latest submissions

See All
graded 286220
graded 286093
graded 284951
Participant Rating
siddharth 0
GenpengXu 0
Participant Rating

Meta CRAG - MM Challenge 2025

Any updates on the results?

5 months ago

Is there any news? Are you going to update the LB or share the results on Discussion forum?

Any updates on the results?

5 months ago

I think after all these issues with the competition, organizers at least owe us ETA of results.

Why did Submission #286683 fail?

6 months ago

I canโ€™t see any logs.

Did the hosts forget to start Phase 2?

7 months ago

Thanks, I guess it is today. Only Task 1 LB seems to be active. Other task LBs are not visible.

Did the hosts forget to start Phase 2?

7 months ago

The deadline is near and we are not able to submit because Phase 2 didnt start.

Submission stuck at submitted

7 months ago

Thanks but it is still stuck at submitted

Submission stuck at submitted

7 months ago

Thanks. Submission #283615

Submission stuck at submitted

7 months ago

One of my submission got stuck in submitted phase even though I can see that it is graded when I click on it. It is also my best LB submission but it didnt update the leaderboard.

Evaluation Method of Leaderboard

7 months ago

@yilun_jin8 thanks. is the re-run complete? Nothing has changed for me.

Evaluation Method of Leaderboard

7 months ago

I am also having a similar issue with my submission.

I get similar number of โ€œI donโ€™t knowโ€ responses and exact correct matches as my local evaluation. But I get zero accuracy from the judge. I feel like the judge api might have errors for my submission. If it was from my side, I wouldnโ€™t be able to have the same missing and exact correct match counts.

aerdem4 has not provided any information yet.