Round 1: Completed
Round 1b: Completed
Phase 2: Completed
#llm
#knowledge_retrieval
#question_answering_systems
#generative_ai
#knowledge_graph
#retrieval_summarization
#rag
180.4k
3140
384
6323
This challenge is not accepting submissions anymore.
| Δ | # | Participants | Score | Submission Trend |
Meta KDD Cup 24 - CRAG - Retrieval Summarization Weight: 1.0 |
Meta KDD Cup 24 - CRAG - Knowledge Graph and Web Retrieval Weight: 1.0 |
Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation Weight: 1.0 |
|---|---|---|---|---|---|---|---|
|
01 |
|
4.000 |
Loading...
|
2 0.279 |
0.321
|
0.294
|
|
|
01 |
|
4.000 |
Loading...
|
2 0.279 |
0.321
|
0.294
|
|
|
01 |
|
4.000 |
Loading...
|
2 0.279 |
0.321
|
0.294
|
|
|
02 |
|
11.000 |
Loading...
|
7 0.162 | 2 0.318 | 2 0.251 |
|
|
02 |
TieMoJi
|
11.000 |
Loading...
|
4 0.225 | 3 0.234 | 4 0.201 |
|
|
02 |
|
11.000 |
Loading...
|
7 0.162 | 2 0.318 | 2 0.251 |
|
|
02 |
TieMoJi
|
11.000 |
Loading...
|
4 0.225 | 3 0.234 | 4 0.201 |
|
|
02 |
|
11.000 |
Loading...
|
7 0.162 | 2 0.318 | 2 0.251 |
|
|
02 |
TieMoJi
|
11.000 |
Loading...
|
4 0.225 | 3 0.234 | 4 0.201 |
|
|
03 |
|
12.000 |
Loading...
|
3 0.231 | 4 0.228 | 5 0.18 |
|
|
03 |
|
12.000 |
Loading...
|
3 0.231 | 4 0.228 | 5 0.18 |
|
|
03 |
|
12.000 |
Loading...
|
3 0.231 | 4 0.228 | 5 0.18 |
|
|
04 |
|
13.000 |
Loading...
|
6 0.174 | 4 0.228 | 3 0.211 |
|
|
04 |
|
13.000 |
Loading...
|
6 0.174 | 4 0.228 | 3 0.211 |
|
|
04 |
|
13.000 |
Loading...
|
6 0.174 | 4 0.228 | 3 0.211 |
|
|
05 |
|
24.000 |
Loading...
|
10 0.129 | 8 0.135 | 6 0.115 |
|
|
05 |
|
24.000 |
Loading...
|
10 0.129 | 8 0.135 | 6 0.115 |
|
|
05 |
|
24.000 |
Loading...
|
10 0.129 | 8 0.135 | 6 0.115 |
|
|
06 |
|
25.000 |
Loading...
|
10 0.129 | 9 0.123 | 6 0.115 |
|
|
06 |
|
25.000 |
Loading...
|
10 0.129 | 9 0.123 | 6 0.115 |
|
|
06 |
|
25.000 |
Loading...
|
10 0.129 | 9 0.123 | 6 0.115 |
|
|
07 |
ruleisallyouneed
|
30.000 |
Loading...
|
10 0.129 | 7 0.147 | 13 0.059 |
|
|
07 |
ruleisallyouneed
|
30.000 |
Loading...
|
10 0.129 | 7 0.147 | 13 0.059 |
|
|
07 |
ruleisallyouneed
|
30.000 |
Loading...
|
10 0.129 | 7 0.147 | 13 0.059 |
|
|
08 |
|
44.000 |
Loading...
|
15 0.108 | 13 0.075 | 16 0.025 |
|
|
08 |
|
44.000 |
Loading...
|
15 0.108 | 13 0.075 | 16 0.025 |
|
|
08 |
|
44.000 |
Loading...
|
15 0.108 | 13 0.075 | 16 0.025 |
|
|
09 |
|
47.000 |
Loading...
|
21 0.072 | 15 0.072 | 11 0.08 |
|
|
09 |
|
47.000 |
Loading...
|
21 0.072 | 15 0.072 | 11 0.08 |
|
|
09 |
|
47.000 |
Loading...
|
21 0.072 | 15 0.072 | 11 0.08 |
|
|
10 |
jax_yu
|
50.000 |
Loading...
|
17 0.096 | 12 0.081 | 21 0.003 |
|
|
10 |
jax_yu
|
50.000 |
Loading...
|
17 0.096 | 12 0.081 | 21 0.003 |
|
|
10 |
jax_yu
|
50.000 |
Loading...
|
17 0.096 | 12 0.081 | 21 0.003 |
|
|
11 |
|
51.000 |
Loading...
|
19 0.075 | 17 0.057 | 15 0.037 |
|
|
11 |
|
51.000 |
Loading...
|
19 0.075 | 17 0.057 | 15 0.037 |
|
|
11 |
|
51.000 |
Loading...
|
19 0.075 | 17 0.057 | 15 0.037 |
|
|
12 |
|
52.000 |
Loading...
|
19 0.075 | 13 0.075 | 20 0.009 |
|
|
12 |
|
52.000 |
Loading...
|
19 0.075 | 13 0.075 | 20 0.009 |
|
|
12 |
|
52.000 |
Loading...
|
19 0.075 | 13 0.075 | 20 0.009 |
|
|
13 |
|
60.000 |
Loading...
|
29 0.042 | 21 0.051 | 10 0.087 |
|
|
13 |
|
60.000 |
Loading...
|
29 0.042 | 21 0.051 | 10 0.087 |
|
|
13 |
|
60.000 |
Loading...
|
29 0.042 | 21 0.051 | 10 0.087 |
|
|
14 |
|
63.000 |
Loading...
|
26 0.057 | 16 0.063 | 21 0.003 |
|
|
14 |
|
63.000 |
Loading...
|
15 0.108 | 17 0.057 | 31 -0.043 |
|
|
14 |
|
63.000 |
Loading...
|
15 0.108 | 17 0.057 | 31 -0.043 |
|
|
14 |
|
63.000 |
Loading...
|
26 0.057 | 16 0.063 | 21 0.003 |
|
|
14 |
|
63.000 |
Loading...
|
15 0.108 | 17 0.057 | 31 -0.043 |
|
|
14 |
|
63.000 |
Loading...
|
26 0.057 | 16 0.063 | 21 0.003 |
|
|
15 |
|
69.000 |
Loading...
|
33 0.033 | 20 0.054 | 16 0.025 |
|
|
15 |
li_mark
|
69.000 |
Loading...
|
23 0.069 | 27 0.0 | 19 0.015 |