AIcrowd | Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

12k

3033

384

927

db3

0.294

APEX

0.251

StarTeam

0.211

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.294	0.328	0.517	0.223	0.260	21.496	5	Wed, 19 Jun 2024 18:48	Loading...	View
02	APEX	0.251	0.279	0.443	0.192	0.365	17.782	7	Wed, 19 Jun 2024 19:41	Loading...	View
03	StarTeam	0.211	0.204	0.365	0.155	0.480	3.095	6	Thu, 20 Jun 2024 16:43	Loading...	View
04	TieMoJi	0.201	0.232	0.372	0.170	0.458	13.865	12	Tue, 18 Jun 2024 12:43	Loading...	View
05	dRAGonRAnGers	0.180	0.189	0.396	0.217	0.387	14.508	16	Thu, 20 Jun 2024 22:39	Loading...	View
06	md_dh	0.136	0.167	0.313	0.176	0.511	14.375	9	Sat, 22 Jun 2024 14:40	Loading...	View
07	chatchat	0.118	0.059	0.276	0.158	0.567	8.361	24	Sat, 22 Jun 2024 06:20	Loading...	View
08	5the4th	0.115	0.062	0.257	0.142	0.601	17.207	3	Sat, 8 Jun 2024 14:44	Loading...	View
08	ElectricSheep	0.115	0.111	0.266	0.152	0.582	18.997	17	Tue, 18 Jun 2024 07:18	Loading...	View
10	STAIR	0.105	0.046	0.254	0.149	0.598	8.947	14	Sun, 9 Jun 2024 11:07	Loading...	View
11	Future	0.096	0.111	0.152	0.056	0.793	4.630	8	Sat, 22 Jun 2024 18:53	Loading...	View
12	vslyu-team	0.093	0.161	0.409	0.316	0.276	14.553	3	Thu, 20 Jun 2024 16:42	Loading...	View
13	ETSLab	0.071	0.090	0.251	0.180	0.570	5.892	5	Tue, 11 Jun 2024 03:31	Loading...	View
14	Riviera4	0.059	0.031	0.167	0.108	0.724	12.536	4	Wed, 12 Jun 2024 09:04	Loading...	View
14	ruleisallyouneed	0.059	0.105	0.375	0.316	0.310	9.744	8	Fri, 14 Jun 2024 16:50	Loading...	View
16	NTT-DOCOMO-LABS	0.037	0.090	0.155	0.118	0.728	10.314	3	Thu, 20 Jun 2024 23:33	Loading...	View
17	Tatter	0.025	0.031	0.111	0.087	0.802	6.672	11	Fri, 14 Jun 2024 02:39	Loading...	View
17	bumblebee7	0.025	0.000	0.170	0.146	0.684	5.891	2	Wed, 19 Jun 2024 09:58	Loading...	View
17	Starfruit	0.025	0.009	0.307	0.282	0.412	16.931	14	Thu, 20 Jun 2024 02:16	Loading...	View
20	li_mark	0.015	0.003	0.180	0.164	0.656	8.421	5	Thu, 20 Jun 2024 07:40	Loading...	View
21	DMIR	0.009	0.065	0.201	0.192	0.607	12.436	14	Tue, 11 Jun 2024 10:33	Loading...	View
22	jax_yu	0.003	0.115	0.276	0.272	0.452	24.201	11	Thu, 20 Jun 2024 00:19	Loading...	View
22	pinchos	0.003	0.043	0.080	0.077	0.842	5.044	28	Thu, 20 Jun 2024 10:51	Loading...	View
24	Olive_0	0.000	0.000	0.000	0.000	1.000	0.654	5	Thu, 13 Jun 2024 13:18	Loading...	View
24	Arun	0.000	0.000	0.000	0.000	1.000	0.615	3	Sun, 16 Jun 2024 01:07	Loading...	View
24	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.576	19	Thu, 20 Jun 2024 05:00	Loading...	View
24	AkiraAI	0.000	0.000	0.000	0.000	1.000	6.365	2	Thu, 20 Jun 2024 14:10	Loading...	View
24	Loong	0.000	0.000	0.000	0.000	1.000	2.101	1	Thu, 20 Jun 2024 15:43	Loading...	View
29	RAGnarok_Retrievers	-0.006	0.068	0.279	0.285	0.437	11.464	16	Thu, 20 Jun 2024 19:09	Loading...	View
30	crag	-0.028	0.009	0.198	0.226	0.576	4.540	4	Sat, 8 Jun 2024 03:47	Loading...	View
31	HWTL_SDU_web_kg	-0.031	0.056	0.155	0.186	0.659	6.776	1	Thu, 20 Jun 2024 01:59	Loading...	View
32	taylor	-0.043	0.074	0.155	0.198	0.647	2.839	3	Thu, 20 Jun 2024 09:05	Loading...	View
33	HWTL_SDU_kg	-0.053	0.046	0.136	0.189	0.675	4.425	5	Thu, 20 Jun 2024 02:30	Loading...	View
34	TripleForce	-0.062	0.015	0.229	0.291	0.480	4.864	1	Thu, 20 Jun 2024 15:53	Loading...	View
35	UM6P	-0.087	0.019	0.276	0.362	0.362	6.089	2	Sat, 22 Jun 2024 00:02	Loading...	View
36	Shimmering_as_the_stars	-0.093	0.015	0.257	0.350	0.393	8.440	3	Tue, 18 Jun 2024 01:39	Loading...	View
37	Ssrhgjz	-0.096	0.022	0.260	0.356	0.384	2.769	8	Sun, 9 Jun 2024 10:43	Loading...	View
38	A100isallyourneed	-0.133	0.019	0.251	0.384	0.365	3.645	7	Mon, 17 Jun 2024 07:49	Loading...	View