AIcrowd | Meta KDD Cup 24 - CRAG - Knowledge Graph and Web Retrieval

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #llm #knowledge_retrieval #question_answering_systems #knowledge_graph #retrieval_summarization Weight: 1.0

Meta

10.3k

2753

384

1006

db3

0.3

dRAGonRAnGers

0.165

StarTeam

0.153

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	🌟 CRAG Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.300	0.372	0.502	0.201	0.297	20.385	18	Sat, 25 May 2024 16:02	Loading...	View
02	dRAGonRAnGers	0.165	0.162	0.285	0.120	0.595	11.384	20	Tue, 21 May 2024 07:22	Loading...	View
03	StarTeam	0.153	0.150	0.345	0.192	0.462	2.072	16	Sun, 26 May 2024 17:12	Loading...	View
04	LexiXu	0.096	0.000	0.135	0.039	0.826	6.677	1	Mon, 27 May 2024 15:40	Loading...	View
05	5the4th	0.087	0.066	0.198	0.111	0.691	5.840	16	Fri, 24 May 2024 23:43	Loading...	View
05	DMIR	0.087	0.096	0.231	0.144	0.625	5.156	4	Sat, 25 May 2024 18:15	Loading...	View
07	Anti	0.078	0.048	0.186	0.108	0.706	6.451	2	Fri, 24 May 2024 14:52	Loading...	View
08	bumblebee7	0.075	0.000	0.174	0.099	0.727	7.643	2	Sun, 26 May 2024 10:12	Loading...	View
09	Future	0.066	0.093	0.111	0.045	0.844	4.273	4	Fri, 24 May 2024 03:34	Loading...	View
10	APEX	0.063	0.057	0.174	0.111	0.715	5.865	10	Fri, 24 May 2024 14:27	Loading...	View
10	ElectricSheep	0.063	0.060	0.177	0.114	0.709	4.916	2	Mon, 27 May 2024 11:30	Loading...	View
12	TieMoJi	0.054	0.213	0.321	0.267	0.411	5.031	11	Mon, 20 May 2024 09:53	Loading...	View
12	li_mark	0.054	0.006	0.228	0.174	0.598	0.742	6	Sun, 26 May 2024 10:28	Loading...	View
14	Tatter	0.051	0.000	0.180	0.129	0.691	23.376	5	Sat, 25 May 2024 14:02	Loading...	View
14	UM6P	0.051	0.024	0.339	0.288	0.372	7.959	6	Sun, 26 May 2024 22:26	Loading...	View
16	vslyu-team	0.039	0.042	0.054	0.015	0.931	0.400	12	Tue, 21 May 2024 06:53	Loading...	View
17	Riviera4	0.033	0.042	0.186	0.153	0.661	10.909	2	Wed, 22 May 2024 05:57	Loading...	View
18	STAIR	0.018	0.057	0.252	0.234	0.514	5.240	1	Mon, 27 May 2024 12:36	Loading...	View
19	pinchos	0.006	0.003	0.021	0.015	0.964	2.586	4	Mon, 20 May 2024 08:19	Loading...	View
19	s.z	0.006	0.006	0.009	0.003	0.988	0.065	1	Tue, 21 May 2024 14:00	Loading...	View
21	mohanty	0.000	0.000	0.000	0.000	1.000	0.062	3	Wed, 15 May 2024 01:16	Loading...	View
21	R-Pioneers	0.000	0.000	0.000	0.000	1.000	20.463	10	Thu, 16 May 2024 02:19	Loading...	View
21	Hermes	0.000	0.000	0.000	0.000	1.000	0.063	1	Thu, 16 May 2024 03:46	Loading...	View
21	sk2020	0.000	0.000	0.000	0.000	1.000	0.066	1	Thu, 16 May 2024 08:25	Loading...	View
21	Olive_0	0.000	0.000	0.000	0.000	1.000	0.065	1	Mon, 20 May 2024 04:53	Loading...	View
21	TAI	0.000	0.000	0.000	0.000	1.000	0.066	3	Wed, 22 May 2024 17:29	Loading...	View
21	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.063	9	Thu, 23 May 2024 01:31	Loading...	View
21	dut_qi	0.000	0.000	0.000	0.000	1.000	0.063	9	Thu, 23 May 2024 06:53	Loading...	View
21	HWTL_SDU_web_kg	0.000	0.111	0.258	0.258	0.483	2.769	2	Thu, 23 May 2024 07:04	Loading...	View
21	T4-takusan-hosii	0.000	0.000	0.000	0.000	1.000	0.063	3	Thu, 23 May 2024 11:24	Loading...	View
21	Arun	0.000	0.000	0.000	0.000	1.000	0.062	2	Thu, 23 May 2024 22:52	Loading...	View
21	ETSLab	0.000	0.000	0.000	0.000	1.000	0.065	2	Sat, 25 May 2024 01:19	Loading...	View
21	Starfruit	0.000	0.000	0.000	0.000	1.000	0.063	16	Sat, 25 May 2024 14:35	Loading...	View
21	kehan_yin	0.000	0.000	0.000	0.000	1.000	0.063	2	Sat, 25 May 2024 15:49	Loading...	View
21	dalaodaiwo	0.000	0.000	0.000	0.000	1.000	0.068	1	Sun, 26 May 2024 06:59	Loading...	View
21	hero_for_fun	0.000	0.000	0.000	0.000	1.000	0.063	1	Sun, 26 May 2024 10:32	Loading...	View
21	YAMALEX	0.000	0.000	0.000	0.000	1.000	0.063	1	Sun, 26 May 2024 14:34	Loading...	View
21	ragnarok	0.000	0.000	0.000	0.000	1.000	0.061	1	Sun, 26 May 2024 17:42	Loading...	View
21	BeyondFate	0.000	0.000	0.000	0.000	1.000	0.063	1	Sun, 26 May 2024 20:06	Loading...	View
21	jax_yu	0.000	0.000	0.003	0.003	0.994	0.066	3	Mon, 27 May 2024 01:45	Loading...	View
21	NTT-DOCOMO-LABS	0.000	0.000	0.000	0.000	1.000	0.061	1	Mon, 27 May 2024 01:54	Loading...	View
21	small_guy	0.000	0.000	0.000	0.000	1.000	0.068	1	Mon, 27 May 2024 12:48	Loading...	View
21	CAU_KG	0.000	0.000	0.000	0.000	1.000	0.063	4	Mon, 27 May 2024 23:12	Loading...	View
44	Memento	-0.033	0.030	0.258	0.291	0.450	3.803	1	Sat, 25 May 2024 13:52	Loading...	View
45	TripleForce	-0.045	0.021	0.144	0.189	0.667	3.293	3	Wed, 22 May 2024 23:38	Loading...	View
46	Hydra	-0.057	0.027	0.243	0.300	0.456	0.687	4	Tue, 21 May 2024 15:01	Loading...	View
47	helencheung	-0.066	0.030	0.234	0.300	0.465	0.733	7	Wed, 22 May 2024 03:50	Loading...	View
48	rag-friends	-0.069	0.027	0.237	0.306	0.456	0.705	2	Sun, 26 May 2024 00:57	Loading...	View
49	LMU_ADL	-0.075	0.027	0.234	0.309	0.456	0.686	1	Mon, 27 May 2024 13:19	Loading...	View
50	DarkSouls	-0.081	0.027	0.231	0.312	0.456	0.705	5	Wed, 22 May 2024 07:02	Loading...	View