
Badges
Activity
Challenge Categories
Challenges Entered
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See All| failed | 287831 | ||
| graded | 285135 | ||
| graded | 285105 |
Improve RAG with Real-World Benchmarks
Latest submissions
Revolutionise E-Commerce with LLM!
Latest submissions
Amazon KDD Cup 2023
Latest submissions
Make Informed Decisions with Shopping Knowledge
Latest submissions
Generating answers using image-linked data
Latest submissions
See All| graded | 285135 | ||
| graded | 284209 | ||
| failed | 283368 |
| Participant | Rating |
|---|
| Participant | Rating |
|---|
-
NTT-DOCOMO-LABS Amazon KDD Cup 2024: Multi-Task Online Shopping Challenge for LLMsView
-
otonadake Meta CRAG - MM Challenge 2025View
Meta CRAG - MM Challenge 2025
๐ Meta CRAG Challenge 2025 Winners Announcement
5 months ago@snehananavati @yilun_jin8 @Jiaqi
As the KDDCUP workshop is approaching, would it be possible for you to clarify the presentation format and presenting teams for the day?
We look forward to meeting the KDDCUP organizers on-site!
๐ Meta CRAG Challenge 2025 Winners Announcement
5 months agoThank you for sharing of final result.
I would appreciate it if you could also provide more details on the following categories.
(including whether it is an indicator for any one of Tasks 1-3 or across Tasks 1-3)
Special Question Category Winners
Simple Question
Multi-hop Question
Comparison Question
Reasoning Question
How to use private model
7 months ago@jyotish
Thank you for your quick response.
Even if I grant aicrowd access rights to the huggface repository using the method above and submit, I still get an error that seems to be a permission issue, so Iโll investigate the cause of the error.
How to use private model
7 months ago@jyotish
Thanks for the reply!
So, am I correct in understanding that the correct repository name for huggingface is โyour-team/aicrowd-your-modelโ and aicrowd.json should be as follows?
(This is different from how aicrowd.json is described in Using Gated Hugging Face Models in Your Submission)
"hf_models": [
{
"repo_id": "your-team/aicrowd-your-model",
"revision": "main"
}
]
How to use private model
7 months ago@yilun_jin8
As the deadline for Phase 1 is approaching, we will add a mention.
Thank you in advance.
How to use private model
7 months ago@mohanty
I would like to know how to submit a private model.
Using Gated Hugging Face Models in Your Submission states that aicrowd.json must include โaicrowdโ in the โrepository nameโ of huggingface, and provides the following example.
On the other hand, since the part of <owner>/<model name> of a hugging face account that has already been created is the username, it is difficult to change it (when I actually tried to change it, I got a warning that the username can only be changed once).
"hf_models": [
{
"repo_id": "your-team-aicrowd/your-model",
"revision": "main"
}
]
Also, Getting Started with Repositories states that the model name in <owner>/<model name> is the repository name, as follows:
3.Enter your modelโs name. This will also be the name of the repository.
For this reason, I thought the following might be correct, so I prepared a gated hugging face model like the one below and submitted it, but an error occurred.
"hf_models": [
{
"repo_id": "your-team/aicrowd-your-model",
"revision": "main"
}
]
In that case, do I need to include aicrowd in the part of <owner>/<model name> in Using Gated Hugging Face Models in Your Submission?
In other words, do I really need to change the username of the huggingface account Iโve already created?
Amazon KDD Cup 2024: Multi-Task Online Shopping Ch
The maximum number of players per team.
Over 1 year agoHello.
Could you please tell me the maximum number of players per team for this competition?
The competition rules and discussions donโt seem to mention this, but if Iโve overlooked it, my apologies.
๐ Meta CRAG Challenge 2025 Winners Announcement
5 months ago@snehananavati
Thank you for your reply.
My question has been answered in the following thread, so no further reply is necessary. Thank you very much.