AIcrowd | Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

11.8k

2995

384

927

db3

0.3

dRAGonRAnGers

0.124

StarTeam

0.087

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	🌟 CRAG Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.300	0.322	0.517	0.217	0.266	22.194	21	Sun, 26 May 2024 07:14	Loading...	View
02	dRAGonRAnGers	0.124	0.080	0.207	0.084	0.709	12.014	17	Sat, 25 May 2024 23:36	Loading...	View
03	StarTeam	0.087	0.118	0.155	0.068	0.777	2.199	15	Sun, 26 May 2024 17:05	Loading...	View
04	Future	0.080	0.099	0.111	0.031	0.858	4.802	2	Fri, 24 May 2024 03:39	Loading...	View
05	APEX	0.071	0.050	0.183	0.111	0.706	8.299	9	Sat, 25 May 2024 10:34	Loading...	View
06	5the4th	0.031	0.062	0.139	0.108	0.752	17.590	18	Sat, 25 May 2024 14:29	Loading...	View
07	DMIR	0.028	0.065	0.211	0.183	0.607	12.589	5	Sat, 25 May 2024 15:16	Loading...	View
08	Tatter	0.015	0.000	0.124	0.108	0.768	22.510	11	Mon, 20 May 2024 05:16	Loading...	View
08	STAIR	0.015	0.056	0.291	0.276	0.433	6.100	1	Mon, 27 May 2024 13:53	Loading...	View
10	vslyu-team	0.009	0.003	0.009	0.000	0.991	0.646	8	Wed, 15 May 2024 09:19	Loading...	View
10	pinchos	0.009	0.003	0.009	0.000	0.991	21.517	3	Mon, 20 May 2024 05:22	Loading...	View
12	jax_yu	0.006	0.000	0.006	0.000	0.994	0.613	13	Mon, 27 May 2024 01:46	Loading...	View
13	mohanty	0.000	0.000	0.000	0.000	1.000	0.595	2	Wed, 15 May 2024 00:55	Loading...	View
13	Hermes	0.000	0.000	0.000	0.000	1.000	0.650	3	Thu, 16 May 2024 02:53	Loading...	View
13	sk2020	0.000	0.000	0.000	0.000	1.000	3.355	1	Thu, 16 May 2024 07:44	Loading...	View
13	Olive_0	0.000	0.000	0.000	0.000	1.000	0.643	1	Mon, 20 May 2024 05:41	Loading...	View
13	DefaultTeam	0.000	0.000	0.000	0.000	1.000	0.603	2	Mon, 20 May 2024 06:30	Loading...	View
13	TAI	0.000	0.000	0.000	0.000	1.000	0.657	3	Wed, 22 May 2024 17:30	Loading...	View
13	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.646	2	Thu, 23 May 2024 01:34	Loading...	View
13	Arun	0.000	0.000	0.000	0.000	1.000	0.598	1	Thu, 23 May 2024 04:21	Loading...	View
13	T4-takusan-hosii	0.000	0.000	0.000	0.000	1.000	0.647	1	Thu, 23 May 2024 05:18	Loading...	View
13	dut_qi	0.000	0.000	0.000	0.000	1.000	0.648	9	Thu, 23 May 2024 07:07	Loading...	View
13	Riviera4	0.000	0.000	0.000	0.000	1.000	4.686	7	Fri, 24 May 2024 00:34	Loading...	View
13	ETSLab	0.000	0.000	0.000	0.000	1.000	0.619	3	Sat, 25 May 2024 01:21	Loading...	View
13	kehan_yin	0.000	0.000	0.000	0.000	1.000	0.600	3	Sat, 25 May 2024 15:49	Loading...	View
13	Starfruit	0.000	0.000	0.000	0.000	1.000	0.617	9	Sat, 25 May 2024 16:11	Loading...	View
13	dalaodaiwo	0.000	0.000	0.000	0.000	1.000	0.658	1	Sun, 26 May 2024 07:28	Loading...	View
13	yly01	0.000	0.000	0.000	0.000	1.000	0.651	3	Sun, 26 May 2024 14:00	Loading...	View
13	YAMALEX	0.000	0.000	0.000	0.000	1.000	0.647	1	Sun, 26 May 2024 14:37	Loading...	View
13	hero_for_fun	0.000	0.000	0.000	0.000	1.000	0.853	2	Sun, 26 May 2024 14:44	Loading...	View
13	ragnarok	0.000	0.000	0.000	0.000	1.000	0.609	1	Sun, 26 May 2024 17:50	Loading...	View
13	BeyondFate	0.000	0.000	0.000	0.000	1.000	0.643	1	Sun, 26 May 2024 20:07	Loading...	View
13	NTT-DOCOMO-LABS	0.000	0.000	0.000	0.000	1.000	0.579	1	Mon, 27 May 2024 01:56	Loading...	View
13	small_guy	0.000	0.000	0.000	0.000	1.000	0.607	1	Mon, 27 May 2024 13:21	Loading...	View
35	li_mark	-0.019	0.006	0.232	0.251	0.517	1.671	7	Sun, 26 May 2024 22:48	Loading...	View
36	CheetahCommando	-0.022	0.037	0.121	0.142	0.737	0.890	5	Fri, 24 May 2024 05:50	Loading...	View
37	pavel_orlov	-0.040	0.025	0.099	0.139	0.762	1.425	3	Sun, 26 May 2024 17:33	Loading...	View
38	UM6P	-0.074	0.006	0.248	0.322	0.430	5.640	1	Fri, 24 May 2024 10:19	Loading...	View
39	chatchat	-0.084	0.046	0.105	0.189	0.706	4.479	12	Mon, 20 May 2024 01:44	Loading...	View
40	helencheung	-0.099	0.025	0.245	0.344	0.412	3.036	5	Wed, 22 May 2024 03:53	Loading...	View
41	Ssrhgjz	-0.105	0.000	0.111	0.217	0.672	3.174	6	Thu, 23 May 2024 02:05	Loading...	View
42	rag-friends	-0.115	0.019	0.260	0.375	0.365	3.041	2	Fri, 24 May 2024 21:23	Loading...	View
43	NeedleFinders	-0.124	0.006	0.238	0.362	0.399	11.103	2	Fri, 24 May 2024 09:37	Loading...	View
44	woody	-0.130	0.074	0.272	0.402	0.325	3.058	1	Fri, 17 May 2024 10:13	Loading...	View
45	TripleForce	-0.136	0.019	0.248	0.384	0.368	2.847	1	Sun, 19 May 2024 11:10	Loading...	View
46	LMU_ADL	-0.146	0.022	0.241	0.387	0.372	2.970	1	Mon, 27 May 2024 13:16	Loading...	View
47	TieMoJi	-0.232	0.229	0.375	0.607	0.019	17.021	3	Wed, 22 May 2024 09:12	Loading...	View
48	ANT-DTAI	-0.257	0.012	0.214	0.471	0.316	0.895	2	Tue, 21 May 2024 04:36	Loading...	View
49	deepx	-0.266	0.000	0.180	0.446	0.375	0.869	1	Mon, 27 May 2024 08:21	Loading...	View
50	llamarag	-0.350	0.000	0.084	0.433	0.483	3.174	2	Mon, 27 May 2024 02:41	Loading...	View