
Organization
Location
Badges
Activity
Challenge Categories
Challenges Entered
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See All| graded | 285075 | ||
| failed | 285002 |
Improve RAG with Real-World Benchmarks
Latest submissions
See All| graded | 266964 | ||
| graded | 266361 | ||
| graded | 266317 |
Shopping Session Dataset
Latest submissions
Testing RAG Systems with Limited Web Pages
Latest submissions
See All| graded | 266964 | ||
| graded | 266361 | ||
| graded | 266317 |
| Participant | Rating |
|---|---|
YeYang
|
0 |
dako
|
0 |
| Participant | Rating |
|---|
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
It's time update Private leadboard?
Over 1 year ago@aicrowd_team I would like to know why the Phase 2 leaderboard has disappeared. Could you please inform me of the reason? Could you please restore the Phase 2 leaderboard and announce the final evaluation on Phase 2 final evaluation leadboard?
Has the Winner Notification already been sent?
Over 1 year ago@aicrowd_team I would like to know why the Phase 2 leaderboard has disappeared. Could you please inform me of the reason?
Has the Winner Notification already been sent?
Over 1 year ago@aicrowd_team Why only notify the winners via email? As a competition participant, shouldnโt the results be updated on the platformโs leaderboard? I believe this shows respect for the time and effort each participant has invested.
Has the Winner Notification already been sent?
Over 1 year agoIt seems they have forgot the competition ![]()
It's time update Private leadboard?
Over 1 year agoItโs been almost two months since the competition ended. Shouldnโt the results be announced by now? Or at least the results of the automated scoring? Or has this competition been forgotten?
๐ฌ Welcome to KDD Cup 2024: CRAG Comprehensive RAG Benchmark Challenge
Over 1 year agoItโs already July 15th, and the final results still havenโt been announced? Or has this competition been forgotten?
When can we expect to receive the final results? The 15th of July is too late
Over 1 year agoThe deadline for the paper is July 30th, but if the results only come out on July 15th, it will be difficult to have enough time to prepare the paper.
Meta KDD Cup 24 - CRAG - Retrieval Summarization
The evaluation queue seems to be completely congested. Should the operations staff check for some timed-out tasks and kill them to clear the queue?
Over 1 year agoThe evaluation queue seems to be completely congested. Should the operations staff check for some timed-out tasks and kill them to clear the queue?
RuntimeError: Found no NVIDIA driver on your system
Over 1 year agoI submitted the official rag baseline code, but it encountered an error during execution. It appears that the evaluation machine is running on a CPU? Or perhaps itโs not utilizing the CUDA driver. This issue seems to require an official resolution and I donโt change dockerfile
error info:
File "/home/aicrowd/.conda/lib/python3.8/site-packages/torch/cuda/__init__.py", line 293, in _lazy_init
File "/home/aicrowd/.conda/lib/python3.8/site-packages/torch/cuda/__init__.py", line 293, in _lazy_init
torch._C._cuda_init()
torch._C._cuda_init()
RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Submit error
Over 1 year agowhen I do git push origin master, get error
Total 43 (delta 6), reused 0 (delta 0)
remote: ===================================================================
remote: SYSTEM MAINTENANCE NOTICE
remote: ===================================================================
remote:
remote: We are currently performing scheduled maintenance.
remote: Submissions are temporarily unavailable.
remote:
remote: Please try submitting again after:
remote: 15:00 CEST on April 28, 2024.
remote:
remote: Thank you for your patience!
remote:
Has the Winner Notification already been sent?
Over 1 year agoI believe that the current date has already exceeded the official deadline of July 15th, which is highly unprofessional. As the organizer, you should at least provide an update on the current progress. There has been a complete lack of respect for the participants. As a competition platform, shouldnโt the results be published on the leaderboard instead of just being sent through email?