
Organization
Location
Badges
Activity
Challenge Categories
Challenges Entered
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See Allsubmitted | 284272 | ||
graded | 284271 | ||
graded | 284253 |
Improve RAG with Real-World Benchmarks
Latest submissions
Revolutionise E-Commerce with LLM!
Latest submissions
Testing RAG Systems with Limited Web Pages
Latest submissions
Enhance RAG systems With Multiple Web Sources & Mock API
Latest submissions
Participant | Rating |
---|
Participant | Rating |
---|
Meta CRAG - MM Challenge 2025

How to use private model
3 months agoHello everyone,
The official submission document mentioned “hf_models: A list of Hugging Face models your agent depends on. These models must be publicly available or the aicrowd HF account must have access. Important: If your model is private, grant the aicrowd user permission to pull it, or your submission will fail.”
But how do we specifically authorize the private model on huggingface to aicrowd?
Looking forward to your responses and good luck to everyone competing!
Best regards
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937

Can two teams merge during the competition?
About 1 year agoPS:The merged team will not exceed five people.

Can two teams merge during the competition?
About 1 year agoI and my friends are about to start a competition now, and we are preparing to split into two teams to try individually first. If we find in the later stage of the competition that we cannot complete a project on our own, we two teams will then cooperate and merge into one team. Is this allowed by the competition organizers?

Regarding the limitations on the time taken to generate an answer and the number of tokens
About 1 year agoRegarding the limitations on the time and token count for generating an answer, I found two different answers on website (AIcrowd | Meta Comprehensive RAG Benchmark: KDD Cup 2024 | Challenges): one states 5 seconds for 50 tokens, and the other states 10 seconds for 75 bpe tokens. Which one should I consider as the standard?
Additionally, what does ‘75 bpe tokens’ mean, and does it carry the same meaning as ‘75 tokens’?
Thanks!
How to use private model
3 months agoDo I need to create an organization on huggingface and then invite the aicrowd official account to join my organization to share my private model? Is there a more convenient way?