AIcrowd | Meta KDD Cup 24 - CRAG - Knowledge Graph and Web Retrieval

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #llm #knowledge_retrieval #question_answering_systems #knowledge_graph #retrieval_summarization Weight: 1.0

Meta

10.3k

2753

384

1006

db3

0.321

APEX

0.318

TieMoJi 0.234

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.321	0.390	0.511	0.189	0.300	20.287	10	Thu, 20 Jun 2024 13:45	Loading...	View
02	APEX	0.318	0.333	0.450	0.132	0.417	12.315	7	Thu, 20 Jun 2024 10:51	Loading...	View
03	TieMoJi	0.234	0.243	0.300	0.066	0.634	6.648	5	Wed, 12 Jun 2024 12:46	Loading...	View
04	dRAGonRAnGers	0.228	0.165	0.312	0.084	0.604	11.862	41	Wed, 19 Jun 2024 22:36	Loading...	View
04	StarTeam	0.228	0.249	0.405	0.177	0.417	1.476	14	Thu, 20 Jun 2024 16:28	Loading...	View
06	md_dh	0.183	0.219	0.318	0.135	0.547	4.019	2	Thu, 20 Jun 2024 18:04	Loading...	View
07	ruleisallyouneed	0.147	0.150	0.327	0.180	0.492	11.442	1	Sun, 9 Jun 2024 03:13	Loading...	View
08	ElectricSheep	0.135	0.162	0.276	0.141	0.583	17.683	11	Tue, 18 Jun 2024 02:00	Loading...	View
09	5the4th	0.123	0.069	0.243	0.120	0.637	6.916	3	Sat, 15 Jun 2024 05:52	Loading...	View
10	vslyu-team	0.099	0.123	0.177	0.078	0.745	5.443	11	Thu, 20 Jun 2024 13:54	Loading...	View
11	dummy_model	0.096	0.111	0.297	0.201	0.502	9.197	2	Thu, 20 Jun 2024 20:25	Loading...	View
12	jax_yu	0.081	0.111	0.195	0.114	0.691	8.246	1	Thu, 20 Jun 2024 00:25	Loading...	View
13	DMIR	0.075	0.087	0.162	0.087	0.751	7.400	12	Sun, 16 Jun 2024 16:00	Loading...	View
13	bumblebee7	0.075	0.000	0.174	0.099	0.727	7.678	4	Thu, 20 Jun 2024 17:36	Loading...	View
15	Future	0.072	0.087	0.108	0.036	0.856	1.026	2	Thu, 20 Jun 2024 23:09	Loading...	View
16	pinchos	0.063	0.123	0.291	0.228	0.480	9.298	13	Wed, 19 Jun 2024 14:46	Loading...	View
17	crag	0.057	0.045	0.192	0.135	0.673	3.997	3	Sun, 9 Jun 2024 13:27	Loading...	View
17	taylor	0.057	0.048	0.138	0.081	0.781	2.967	4	Thu, 20 Jun 2024 04:22	Loading...	View
17	NTT-DOCOMO-LABS	0.057	0.084	0.207	0.150	0.643	4.767	3	Thu, 20 Jun 2024 14:41	Loading...	View
20	Tatter	0.054	0.000	0.180	0.126	0.694	22.317	9	Sun, 9 Jun 2024 14:27	Loading...	View
21	chatchat	0.051	0.027	0.153	0.102	0.745	6.322	25	Sun, 16 Jun 2024 06:26	Loading...	View
22	T4-takusan-hosii	0.030	0.009	0.231	0.201	0.568	2.591	2	Tue, 18 Jun 2024 07:43	Loading...	View
23	Olive_0	0.021	0.066	0.255	0.234	0.511	8.091	7	Thu, 20 Jun 2024 21:01	Loading...	View
24	RAGnarok_Retrievers	0.018	0.042	0.237	0.219	0.544	7.819	12	Thu, 20 Jun 2024 14:29	Loading...	View
25	R-Pioneers	0.003	0.000	0.003	0.000	0.997	6.564	6	Mon, 17 Jun 2024 10:47	Loading...	View
25	HWTL_SDU_web	0.003	0.072	0.156	0.153	0.691	5.574	3	Wed, 19 Jun 2024 07:59	Loading...	View
27	Riviera4	0.000	0.033	0.132	0.132	0.736	6.962	12	Thu, 13 Jun 2024 02:46	Loading...	View
27	Arun	0.000	0.000	0.000	0.000	1.000	0.063	2	Sun, 16 Jun 2024 01:17	Loading...	View
27	Cool	0.000	0.000	0.258	0.258	0.483	3.646	10	Tue, 18 Jun 2024 07:03	Loading...	View
27	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.062	7	Thu, 20 Jun 2024 04:59	Loading...	View
27	li_mark	0.000	0.000	0.153	0.153	0.694	6.220	5	Thu, 20 Jun 2024 07:29	Loading...	View
27	AkiraAI	0.000	0.000	0.000	0.000	1.000	4.649	6	Thu, 20 Jun 2024 15:29	Loading...	View
27	Loong	0.000	0.000	0.000	0.000	1.000	1.399	2	Thu, 20 Jun 2024 15:44	Loading...	View
34	UM6P	-0.003	0.033	0.279	0.282	0.438	1.811	10	Mon, 17 Jun 2024 00:32	Loading...	View
35	TAI	-0.018	0.021	0.069	0.087	0.844	1.661	5	Sat, 15 Jun 2024 11:40	Loading...	View
36	Ssrhgjz	-0.021	0.048	0.309	0.330	0.360	0.963	6	Fri, 14 Jun 2024 15:13	Loading...	View
36	CheetahCommando	-0.021	0.054	0.306	0.327	0.366	7.657	20	Mon, 17 Jun 2024 01:17	Loading...	View
38	Starfruit	-0.030	0.087	0.252	0.282	0.465	17.290	9	Sat, 8 Jun 2024 01:06	Loading...	View
39	Honkai_Star_Rail_Master	-0.033	0.000	0.057	0.090	0.853	12.429	1	Thu, 20 Jun 2024 14:52	Loading...	View
40	ulpi	-0.054	0.024	0.231	0.285	0.483	1.698	4	Mon, 17 Jun 2024 19:35	Loading...	View
41	A100isallyourneed	-0.072	0.024	0.222	0.294	0.483	1.589	4	Mon, 17 Jun 2024 07:48	Loading...	View
42	HWTL_SDU_kg	-0.075	0.027	0.234	0.309	0.456	0.706	2	Tue, 18 Jun 2024 08:07	Loading...	View
43	DarkSouls	-0.447	0.090	0.273	0.721	0.006	12.377	1	Sat, 15 Jun 2024 14:29	Loading...	View