Loading
0 Follower
0 Following
sure

Organization

USTC

Location

CN

Badges

0
0
0

Activity

Jun
Jul
Aug
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Mon
Wed
Fri

Challenge Categories

Loading...

Challenges Entered

Improve RAG with Real-World Benchmarks | KDD Cup 2025

Latest submissions

See All
submitted 284272
graded 284271
graded 284253

Improve RAG with Real-World Benchmarks

Latest submissions

No submissions made in this challenge.

Latest submissions

No submissions made in this challenge.

Testing RAG Systems with Limited Web Pages

Latest submissions

No submissions made in this challenge.

Enhance RAG systems With Multiple Web Sources & Mock API

Latest submissions

No submissions made in this challenge.
Participant Rating
Participant Rating
  • Love_Live_Master Amazon KDD Cup 2024: Multi-Task Online Shopping Challenge for LLMs
    View
  • APEX Meta Comprehensive RAG Benchmark: KDD Cup 2024
    View
  • APEX Meta CRAG - MM Challenge 2025
    View

Meta CRAG - MM Challenge 2025

How to use private model

3 months ago

Do I need to create an organization on huggingface and then invite the aicrowd official account to join my organization to share my private model? Is there a more convenient way?

How to use private model

3 months ago

Hello everyone,
The official submission document mentioned “hf_models: A list of Hugging Face models your agent depends on. These models must be publicly available or the aicrowd HF account must have access. Important: If your model is private, grant the aicrowd user permission to pull it, or your submission will fail.”

But how do we specifically authorize the private model on huggingface to aicrowd?

Looking forward to your responses and good luck to everyone competing!

Best regards

Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937

Can two teams merge during the competition?

About 1 year ago

PS:The merged team will not exceed five people.

Can two teams merge during the competition?

About 1 year ago

I and my friends are about to start a competition now, and we are preparing to split into two teams to try individually first. If we find in the later stage of the competition that we cannot complete a project on our own, we two teams will then cooperate and merge into one team. Is this allowed by the competition organizers?

Regarding the limitations on the time taken to generate an answer and the number of tokens

About 1 year ago


Regarding the limitations on the time and token count for generating an answer, I found two different answers on website (AIcrowd | Meta Comprehensive RAG Benchmark: KDD Cup 2024 | Challenges): one states 5 seconds for 50 tokens, and the other states 10 seconds for 75 bpe tokens. Which one should I consider as the standard?
Additionally, what does ‘75 bpe tokens’ mean, and does it carry the same meaning as ‘75 tokens’?
Thanks!

work work work