AIcrowd | Meta KDD Cup 24 - CRAG - Retrieval Summarization

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

26.3k

2961

384

4390

AIFIRST

0.459

db3

0.279

dRAGonRAnGers

0.231

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	AIFIRST	0.459	0.147	0.556	0.096	0.348	4.328	19	Thu, 20 Jun 2024 12:39	Loading...	View
02	db3	0.279	0.198	0.435	0.156	0.408	14.309	17	Thu, 20 Jun 2024 07:52	Loading...	View
03	dRAGonRAnGers	0.231	0.168	0.312	0.081	0.607	9.796	67	Thu, 20 Jun 2024 02:03	Loading...	View
04	TieMoJi	0.225	0.213	0.267	0.042	0.691	6.605	7	Wed, 12 Jun 2024 08:51	Loading...	View
05	md_dh	0.186	0.186	0.270	0.084	0.646	3.931	9	Thu, 20 Jun 2024 05:55	Loading...	View
06	StarTeam	0.174	0.162	0.363	0.189	0.447	1.959	8	Sat, 8 Jun 2024 17:13	Loading...	View
07	ETSLab	0.162	0.135	0.330	0.168	0.502	3.004	22	Thu, 20 Jun 2024 05:48	Loading...	View
07	APEX	0.162	0.168	0.312	0.150	0.538	11.973	12	Thu, 20 Jun 2024 16:58	Loading...	View
09	STAIR	0.144	0.093	0.261	0.117	0.622	10.894	18	Thu, 20 Jun 2024 05:30	Loading...	View
10	ElectricSheep	0.129	0.123	0.249	0.120	0.631	13.720	13	Sat, 8 Jun 2024 03:55	Loading...	View
10	ruleisallyouneed	0.129	0.147	0.378	0.249	0.372	8.871	8	Sat, 15 Jun 2024 07:18	Loading...	View
10	5the4th	0.129	0.072	0.246	0.117	0.637	6.859	7	Sun, 16 Jun 2024 00:40	Loading...	View
13	dummy_model	0.117	0.135	0.363	0.246	0.390	13.462	17	Thu, 20 Jun 2024 02:19	Loading...	View
14	yong_deng4	0.114	0.000	0.162	0.048	0.790	4.783	20	Tue, 11 Jun 2024 05:57	Loading...	View
15	taylor	0.108	0.060	0.249	0.141	0.610	3.568	8	Sun, 9 Jun 2024 11:22	Loading...	View
15	bumblebee7	0.108	0.003	0.195	0.087	0.718	13.079	7	Thu, 20 Jun 2024 17:51	Loading...	View
17	jax_yu	0.096	0.114	0.204	0.108	0.688	8.249	28	Sat, 8 Jun 2024 20:32	Loading...	View
18	Lucy	0.078	0.054	0.135	0.057	0.808	3.131	3	Wed, 19 Jun 2024 03:16	Loading...	View
19	DMIR	0.075	0.078	0.159	0.084	0.757	18.552	16	Tue, 11 Jun 2024 09:48	Loading...	View
19	NTT-DOCOMO-LABS	0.075	0.084	0.093	0.018	0.889	1.945	14	Thu, 20 Jun 2024 14:48	Loading...	View
21	UM6P	0.072	0.015	0.366	0.294	0.339	8.033	6	Sun, 9 Jun 2024 21:14	Loading...	View
21	Future	0.072	0.087	0.108	0.036	0.856	1.000	12	Wed, 19 Jun 2024 21:23	Loading...	View
23	li_mark	0.069	0.006	0.153	0.084	0.763	2.492	15	Mon, 17 Jun 2024 05:13	Loading...	View
24	hnu_LH	0.063	0.048	0.225	0.162	0.613	3.761	23	Sun, 16 Jun 2024 03:52	Loading...	View
25	HWTL_SDU_web_kg	0.060	0.072	0.183	0.123	0.694	6.061	10	Tue, 18 Jun 2024 08:23	Loading...	View
26	pinchos	0.057	0.111	0.285	0.228	0.486	7.846	25	Wed, 19 Jun 2024 10:07	Loading...	View
26	NTQ-Solution	0.057	0.012	0.201	0.144	0.655	5.762	6	Thu, 20 Jun 2024 03:33	Loading...	View
28	yly01	0.045	0.021	0.159	0.114	0.727	13.031	17	Thu, 20 Jun 2024 11:49	Loading...	View
29	Eagles	0.042	0.111	0.270	0.228	0.502	4.329	13	Tue, 11 Jun 2024 08:13	Loading...	View
29	chatchat	0.042	0.015	0.141	0.099	0.760	5.050	35	Sun, 16 Jun 2024 10:49	Loading...	View
31	TAI	0.036	0.021	0.171	0.135	0.694	2.641	7	Mon, 10 Jun 2024 15:29	Loading...	View
31	Memento	0.036	0.006	0.057	0.021	0.922	5.803	28	Thu, 20 Jun 2024 06:13	Loading...	View
33	Riviera4	0.033	0.039	0.186	0.153	0.661	11.115	13	Sat, 8 Jun 2024 08:13	Loading...	View
33	Tatter	0.033	0.000	0.117	0.084	0.799	21.297	13	Thu, 13 Jun 2024 03:16	Loading...	View
33	HWTL_SDU_web	0.033	0.072	0.204	0.171	0.625	4.754	15	Mon, 17 Jun 2024 11:43	Loading...	View
36	SPML_MIR	0.018	0.000	0.033	0.015	0.952	3.919	9	Thu, 20 Jun 2024 13:38	Loading...	View
36	TripleForce	0.018	0.129	0.225	0.207	0.568	2.320	10	Thu, 20 Jun 2024 16:42	Loading...	View
38	HWTL_SDU_kg	0.015	0.087	0.192	0.177	0.631	4.756	6	Thu, 20 Jun 2024 02:33	Loading...	View
39	T4-takusan-hosii	0.003	0.012	0.192	0.189	0.619	1.801	9	Thu, 20 Jun 2024 22:37	Loading...	View
40	Olive_0	0.000	0.000	0.000	0.000	1.000	0.065	5	Thu, 13 Jun 2024 13:44	Loading...	View
40	Arun	0.000	0.000	0.000	0.000	1.000	0.062	5	Sun, 16 Jun 2024 00:37	Loading...	View
40	crag	0.000	0.000	0.000	0.000	1.000	0.064	17	Sun, 16 Jun 2024 05:36	Loading...	View
40	NTU-MIR-LAB	0.000	0.000	0.000	0.000	1.000	0.067	18	Wed, 19 Jun 2024 09:29	Loading...	View
40	AkiraAI	0.000	0.000	0.000	0.000	1.000	4.655	14	Wed, 19 Jun 2024 15:07	Loading...	View
40	minhnp2306	0.000	0.000	0.000	0.000	1.000	0.064	14	Thu, 20 Jun 2024 10:59	Loading...	View
40	Loong	0.000	0.000	0.000	0.000	1.000	1.399	1	Thu, 20 Jun 2024 15:08	Loading...	View
47	Equestrians	-0.003	0.000	0.069	0.072	0.859	1.689	4	Mon, 10 Jun 2024 08:13	Loading...	View
48	pavel_orlov	-0.006	0.066	0.249	0.255	0.495	1.068	7	Thu, 20 Jun 2024 12:38	Loading...	View
48	feng_bo_han_1	-0.006	0.009	0.252	0.258	0.489	1.478	3	Thu, 20 Jun 2024 18:58	Loading...	View
50	nwu	-0.021	0.045	0.147	0.168	0.685	1.838	3	Mon, 17 Jun 2024 11:57	Loading...	View