AIcrowd | Meta KDD Cup 24 - CRAG - End-to-End Retrieval-Augmented Generation

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

11.8k

2995

384

927

APEX

0.977

StarTeam

0.97

s.z 0.97

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	🌟 CRAG Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	Entries	Last Submission	Submission Trend
01	APEX	0.977	0.981	0.985	0.008	0.008	2	Sun, 5 May 2024 05:08	Loading...	View
02	StarTeam	0.970	0.981	0.981	0.011	0.008	8	Tue, 30 Apr 2024 05:41	Loading...	View
02	s.z	0.970	0.981	0.981	0.011	0.008	2	Tue, 7 May 2024 04:01	Loading...	View
02	Shimmering_as_the_stars	0.970	0.981	0.981	0.011	0.008	1	Tue, 7 May 2024 05:29	Loading...	View
02	Ssrhgjz	0.970	0.981	0.981	0.011	0.008	2	Thu, 9 May 2024 02:42	Loading...	View
06	vslyu-team	0.891	0.902	0.902	0.011	0.086	6	Sat, 11 May 2024 07:29	Loading...	View
07	Hajwala	0.376	0.598	0.684	0.308	0.008	1	Mon, 13 May 2024 12:25	Loading...	View
08	Tatter	0.342	0.590	0.639	0.297	0.064	4	Sat, 27 Apr 2024 05:44	Loading...	View
09	db3	0.338	0.098	0.538	0.199	0.263	28	Mon, 6 May 2024 06:50	Loading...	View
10	Anti	0.135	0.222	0.278	0.143	0.579	3	Wed, 8 May 2024 06:19	Loading...	View
11	Future	0.041	0.105	0.120	0.079	0.801	2	Tue, 14 May 2024 17:48	Loading...	View
12	dRAGonRAnGers	0.023	0.011	0.184	0.162	0.654	37	Tue, 7 May 2024 03:39	Loading...	View
13	mohanty	0.000	0.000	0.000	0.000	1.000	4	Mon, 1 Apr 2024 20:18	Loading...	View
13	canbin_huang7	0.000	0.000	0.000	0.000	1.000	2	Wed, 17 Apr 2024 09:15	Loading...	View
13	Olive_0	0.000	0.000	0.000	0.000	1.000	2	Wed, 24 Apr 2024 06:51	Loading...	View
13	ChrisTeam	0.000	0.000	0.000	0.000	1.000	1	Wed, 24 Apr 2024 09:26	Loading...	View
13	TTTry	0.000	0.000	0.000	0.000	1.000	7	Wed, 24 Apr 2024 12:29	Loading...	View
13	NTT-DOCOMO-LABS	0.000	0.000	0.000	0.000	1.000	1	Tue, 7 May 2024 08:48	Loading...	View
13	T4-takusan-hosii	0.000	0.000	0.000	0.000	1.000	1	Fri, 10 May 2024 09:56	Loading...	View
13	pinchos	0.000	0.000	0.000	0.000	1.000	2	Sun, 12 May 2024 08:22	Loading...	View
13	sk2020	0.000	0.000	0.000	0.000	1.000	7	Sun, 12 May 2024 09:05	Loading...	View
13	TripleForce	0.000	0.000	0.000	0.000	1.000	3	Sun, 12 May 2024 13:12	Loading...	View
13	jax_yu	0.000	0.000	0.000	0.000	1.000	5	Sun, 12 May 2024 13:26	Loading...	View
13	Hermes	0.000	0.000	0.000	0.000	1.000	1	Tue, 14 May 2024 06:20	Loading...	View
25	UM6P	-0.023	0.034	0.259	0.282	0.459	1	Sat, 11 May 2024 19:16	Loading...	View
26	Speechless.AI	-0.034	0.011	0.011	0.045	0.944	15	Sat, 4 May 2024 00:50	Loading...	View
27	yang2024	-0.053	0.000	0.278	0.331	0.391	6	Tue, 7 May 2024 02:17	Loading...	View
28	mick_r	-0.154	0.030	0.195	0.350	0.455	8	Mon, 29 Apr 2024 03:11	Loading...	View
29	Starfruit	-0.158	0.015	0.305	0.462	0.233	11	Mon, 13 May 2024 03:21	Loading...	View
30	TAL-AuroraX	-0.169	0.342	0.387	0.556	0.056	1	Sat, 11 May 2024 10:39	Loading...	View
31	DMIR	-0.222	0.060	0.139	0.361	0.500	15	Thu, 25 Apr 2024 01:29	Loading...	View
32	Honkai_Star_Rail_Master	-0.301	0.000	0.350	0.650	0.000	1	Wed, 8 May 2024 09:15	Loading...	View
33	AkiraAI	-0.432	0.038	0.282	0.714	0.004	1	Sun, 5 May 2024 16:23	Loading...	View
34	kevin_yan	-0.571	0.034	0.214	0.786	0.000	1	Mon, 13 May 2024 16:11	Loading...	View
35	THUIR	-0.624	0.086	0.188	0.812	0.000	2	Sun, 12 May 2024 09:22	Loading...	View
36	Stella	-0.628	0.011	0.186	0.814	0.000	8	Tue, 16 Apr 2024 05:04	Loading...	View
37	sansa	-0.680	0.004	0.160	0.840	0.000	6	Sat, 20 Apr 2024 21:23	Loading...	View
38	TestAccount123	-0.688	0.000	0.156	0.844	0.000	1	Fri, 19 Apr 2024 19:51	Loading...	View
39	SuoHa	-0.699	0.000	0.150	0.850	0.000	2	Fri, 3 May 2024 13:43	Loading...	View
40	A100isallyourneed	-0.865	0.000	0.068	0.932	0.000	1	Fri, 10 May 2024 14:44	Loading...	View