
Organization
Location
Badges
Activity
Challenge Categories
Challenges Entered
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See Allgraded | 285075 | ||
failed | 285002 |
Improve RAG with Real-World Benchmarks
Latest submissions
See Allgraded | 266964 | ||
graded | 266361 | ||
graded | 266317 |
Shopping Session Dataset
Latest submissions
Testing RAG Systems with Limited Web Pages
Latest submissions
See Allgraded | 266964 | ||
graded | 266361 | ||
graded | 266317 |
Participant | Rating |
---|---|
![]() |
0 |
![]() |
0 |
Participant | Rating |
---|
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937

It's time update Private leadboard?
11 months ago@aicrowd_team I would like to know why the Phase 2 leaderboard has disappeared. Could you please inform me of the reason? Could you please restore the Phase 2 leaderboard and announce the final evaluation on Phase 2 final evaluation leadboard?

Has the Winner Notification already been sent?
11 months ago@aicrowd_team I would like to know why the Phase 2 leaderboard has disappeared. Could you please inform me of the reason?

Has the Winner Notification already been sent?
11 months ago@aicrowd_team Why only notify the winners via email? As a competition participant, shouldn’t the results be updated on the platform’s leaderboard? I believe this shows respect for the time and effort each participant has invested.

Has the Winner Notification already been sent?
11 months agoIt seems they have forgot the competition

It's time update Private leadboard?
11 months agoIt’s been almost two months since the competition ended. Shouldn’t the results be announced by now? Or at least the results of the automated scoring? Or has this competition been forgotten?

💬 Welcome to KDD Cup 2024: CRAG Comprehensive RAG Benchmark Challenge
11 months agoIt’s already July 15th, and the final results still haven’t been announced? Or has this competition been forgotten?

Any update?
11 months agoIt’s already July 15th, and the final results still haven’t been announced? Or has this competition been forgotten?

When can we expect to receive the final results? The 15th of July is too late
12 months agoThe deadline for the paper is July 30th, but if the results only come out on July 15th, it will be difficult to have enough time to prepare the paper.
Amazon KDD Cup 2024: Multi-Task Online Shopping Ch

Change Team Name Request
11 months agoCan u see see the crag competition, when can we see the private leadboard???
Meta KDD Cup 24 - CRAG - Retrieval Summarization

The evaluation queue seems to be completely congested. Should the operations staff check for some timed-out tasks and kill them to clear the queue?
About 1 year agoThe evaluation queue seems to be completely congested. Should the operations staff check for some timed-out tasks and kill them to clear the queue?

RuntimeError: Found no NVIDIA driver on your system
About 1 year agoI submitted the official rag baseline code, but it encountered an error during execution. It appears that the evaluation machine is running on a CPU? Or perhaps it’s not utilizing the CUDA driver. This issue seems to require an official resolution and I don’t change dockerfile
error info:
File "/home/aicrowd/.conda/lib/python3.8/site-packages/torch/cuda/__init__.py", line 293, in _lazy_init
File "/home/aicrowd/.conda/lib/python3.8/site-packages/torch/cuda/__init__.py", line 293, in _lazy_init
torch._C._cuda_init()
torch._C._cuda_init()
RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Submit error
About 1 year agowhen I do git push origin master, get error
Total 43 (delta 6), reused 0 (delta 0)
remote: ===================================================================
remote: SYSTEM MAINTENANCE NOTICE
remote: ===================================================================
remote:
remote: We are currently performing scheduled maintenance.
remote: Submissions are temporarily unavailable.
remote:
remote: Please try submitting again after:
remote: 15:00 CEST on April 28, 2024.
remote:
remote: Thank you for your patience!
remote:
Has the Winner Notification already been sent?
11 months agoI believe that the current date has already exceeded the official deadline of July 15th, which is highly unprofessional. As the organizer, you should at least provide an update on the current progress. There has been a complete lack of respect for the participants. As a competition platform, shouldn’t the results be published on the leaderboard instead of just being sent through email?