AIcrowd | Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

11.8k

2995

384

927

db3

0.294

APEX

0.251

StarTeam

0.211

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.294	0.328	0.517	0.223	0.260	21.496	5	Wed, 19 Jun 2024 18:48	Loading...	View
02	APEX	0.251	0.279	0.443	0.192	0.365	17.782	7	Wed, 19 Jun 2024 19:41	Loading...	View
03	StarTeam	0.211	0.204	0.365	0.155	0.480	3.095	6	Thu, 20 Jun 2024 16:43	Loading...	View
04	TieMoJi	0.201	0.232	0.372	0.170	0.458	13.865	12	Tue, 18 Jun 2024 12:43	Loading...	View
05	dRAGonRAnGers	0.180	0.189	0.396	0.217	0.387	14.508	11	Thu, 20 Jun 2024 22:39	Loading...	View
06	5the4th	0.115	0.062	0.257	0.142	0.601	17.207	3	Sat, 8 Jun 2024 14:44	Loading...	View
06	ElectricSheep	0.115	0.111	0.266	0.152	0.582	18.997	17	Tue, 18 Jun 2024 07:18	Loading...	View
08	STAIR	0.105	0.046	0.254	0.149	0.598	8.947	14	Sun, 9 Jun 2024 11:07	Loading...	View
09	vslyu-team	0.093	0.161	0.409	0.316	0.276	14.553	3	Thu, 20 Jun 2024 16:42	Loading...	View
10	chatchat	0.087	0.025	0.251	0.164	0.585	10.458	12	Tue, 18 Jun 2024 16:31	Loading...	View
11	Future	0.080	0.111	0.146	0.065	0.789	4.631	6	Sat, 8 Jun 2024 06:13	Loading...	View
12	ETSLab	0.071	0.090	0.251	0.180	0.570	5.892	5	Tue, 11 Jun 2024 03:31	Loading...	View
13	Riviera4	0.059	0.031	0.167	0.108	0.724	12.536	4	Wed, 12 Jun 2024 09:04	Loading...	View
13	ruleisallyouneed	0.059	0.105	0.375	0.316	0.310	9.744	8	Fri, 14 Jun 2024 16:50	Loading...	View
15	NTT-DOCOMO-LABS	0.037	0.090	0.155	0.118	0.728	10.314	3	Thu, 20 Jun 2024 23:33	Loading...	View
16	Tatter	0.025	0.031	0.111	0.087	0.802	6.672	11	Fri, 14 Jun 2024 02:39	Loading...	View
16	bumblebee7	0.025	0.000	0.170	0.146	0.684	5.891	2	Wed, 19 Jun 2024 09:58	Loading...	View
16	Starfruit	0.025	0.009	0.307	0.282	0.412	16.931	14	Thu, 20 Jun 2024 02:16	Loading...	View
19	li_mark	0.015	0.003	0.180	0.164	0.656	8.421	5	Thu, 20 Jun 2024 07:40	Loading...	View
20	DMIR	0.009	0.065	0.201	0.192	0.607	12.436	14	Tue, 11 Jun 2024 10:33	Loading...	View
21	jax_yu	0.003	0.115	0.276	0.272	0.452	24.201	11	Thu, 20 Jun 2024 00:19	Loading...	View
21	pinchos	0.003	0.043	0.080	0.077	0.842	5.044	28	Thu, 20 Jun 2024 10:51	Loading...	View
23	Olive_0	0.000	0.000	0.000	0.000	1.000	0.654	5	Thu, 13 Jun 2024 13:18	Loading...	View
23	Arun	0.000	0.000	0.000	0.000	1.000	0.615	3	Sun, 16 Jun 2024 01:07	Loading...	View
23	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.576	19	Thu, 20 Jun 2024 05:00	Loading...	View
23	AkiraAI	0.000	0.000	0.000	0.000	1.000	6.365	2	Thu, 20 Jun 2024 14:10	Loading...	View
23	Loong	0.000	0.000	0.000	0.000	1.000	2.101	1	Thu, 20 Jun 2024 15:43	Loading...	View
28	RAGnarok_Retrievers	-0.006	0.068	0.279	0.285	0.437	11.464	16	Thu, 20 Jun 2024 19:09	Loading...	View
29	crag	-0.028	0.009	0.198	0.226	0.576	4.540	4	Sat, 8 Jun 2024 03:47	Loading...	View
30	HWTL_SDU_web_kg	-0.031	0.056	0.155	0.186	0.659	6.776	1	Thu, 20 Jun 2024 01:59	Loading...	View
31	taylor	-0.043	0.074	0.155	0.198	0.647	2.839	2	Thu, 20 Jun 2024 09:05	Loading...	View
32	HWTL_SDU_kg	-0.053	0.046	0.136	0.189	0.675	4.425	4	Thu, 20 Jun 2024 02:30	Loading...	View
33	TripleForce	-0.062	0.015	0.229	0.291	0.480	4.864	1	Thu, 20 Jun 2024 15:53	Loading...	View
34	Shimmering_as_the_stars	-0.093	0.015	0.257	0.350	0.393	8.440	3	Tue, 18 Jun 2024 01:39	Loading...	View
35	Ssrhgjz	-0.096	0.022	0.260	0.356	0.384	2.769	8	Sun, 9 Jun 2024 10:43	Loading...	View
36	A100isallyourneed	-0.133	0.019	0.251	0.384	0.365	3.645	5	Mon, 17 Jun 2024 07:49	Loading...	View