AIcrowd | Meta KDD Cup 24 - CRAG - Retrieval Summarization

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

28.1k

3140

384

4390

APEX

0.976

AIFIRST

0.976

Demo

0.976

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	🌟 CRAG Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	Entries	Last Submission	Submission Trend
01	APEX	0.976	0.980	0.988	0.012	0.000	14	Mon, 29 Apr 2024 18:15	Loading...	View
01	AIFIRST	0.976	0.980	0.988	0.012	0.000	21	Tue, 7 May 2024 05:32	Loading...	View
01	Demo	0.976	0.980	0.988	0.012	0.000	4	Wed, 8 May 2024 09:52	Loading...	View
04	good_luck	0.969	0.980	0.984	0.016	0.000	9	Thu, 2 May 2024 08:17	Loading...	View
04	ETSLab	0.969	0.980	0.984	0.016	0.000	7	Sat, 4 May 2024 06:24	Loading...	View
04	Siraegi	0.969	0.980	0.984	0.016	0.000	26	Sat, 4 May 2024 06:32	Loading...	View
04	StarTeam	0.969	0.984	0.984	0.016	0.000	18	Sat, 4 May 2024 18:25	Loading...	View
04	Shimmering_as_the_stars	0.969	0.980	0.984	0.016	0.000	12	Sun, 5 May 2024 06:20	Loading...	View
04	Tornado	0.969	0.980	0.984	0.016	0.000	5	Mon, 6 May 2024 02:12	Loading...	View
04	jjplane	0.969	0.980	0.984	0.016	0.000	23	Wed, 8 May 2024 02:37	Loading...	View
04	vslyu-team	0.969	0.980	0.984	0.016	0.000	25	Fri, 10 May 2024 10:50	Loading...	View
04	LexiXu	0.969	0.980	0.984	0.016	0.000	3	Sat, 11 May 2024 14:21	Loading...	View
04	Hajwala	0.969	0.976	0.976	0.008	0.016	22	Sun, 12 May 2024 05:20	Loading...	View
14	Ssrhgjz	0.961	0.980	0.980	0.020	0.000	37	Fri, 10 May 2024 01:25	Loading...	View
15	STAIR	0.535	0.654	0.768	0.232	0.000	13	Sun, 5 May 2024 16:32	Loading...	View
16	THUIR	0.417	0.634	0.709	0.291	0.000	6	Thu, 9 May 2024 01:32	Loading...	View
17	Tatter	0.398	0.610	0.665	0.268	0.067	18	Mon, 29 Apr 2024 14:14	Loading...	View
18	curiouscrumb	0.366	0.551	0.638	0.272	0.091	13	Sun, 5 May 2024 16:25	Loading...	View
19	db3	0.244	0.264	0.398	0.154	0.449	30	Sun, 12 May 2024 09:57	Loading...	View
20	LGTM	0.197	0.000	0.598	0.402	0.000	9	Tue, 7 May 2024 03:48	Loading...	View
21	TAL-AuroraX	0.189	0.394	0.437	0.248	0.315	21	Mon, 29 Apr 2024 08:37	Loading...	View
22	Anti	0.181	0.244	0.295	0.114	0.591	15	Tue, 7 May 2024 04:20	Loading...	View
23	DarkSouls	0.106	0.039	0.339	0.232	0.429	23	Sun, 12 May 2024 02:09	Loading...	View
24	Riviera4	0.102	0.039	0.189	0.087	0.724	21	Tue, 14 May 2024 09:10	Loading...	View
25	dRAGonRAnGers	0.094	0.012	0.331	0.236	0.433	43	Thu, 25 Apr 2024 00:20	Loading...	View
26	dummy_model	0.091	0.098	0.161	0.071	0.768	41	Tue, 7 May 2024 08:53	Loading...	View
27	Future	0.059	0.114	0.126	0.067	0.807	31	Mon, 13 May 2024 04:57	Loading...	View
28	D5MumboJumbo	0.043	0.039	0.185	0.142	0.673	11	Fri, 26 Apr 2024 08:51	Loading...	View
28	NxTeam	0.043	0.028	0.150	0.106	0.744	15	Sat, 27 Apr 2024 02:15	Loading...	View
30	Naruto0	0.039	0.035	0.303	0.264	0.433	12	Fri, 10 May 2024 10:47	Loading...	View
31	nicholas_liu	0.024	0.043	0.177	0.154	0.669	6	Fri, 26 Apr 2024 07:03	Loading...	View
31	bumblebee7	0.024	0.000	0.134	0.110	0.756	14	Tue, 30 Apr 2024 13:07	Loading...	View
33	yang2024	0.012	0.000	0.043	0.031	0.925	11	Tue, 7 May 2024 04:05	Loading...	View
34	Speechless.AI	0.008	0.185	0.248	0.240	0.512	23	Thu, 2 May 2024 13:00	Loading...	View
35	coconut	0.004	0.035	0.276	0.272	0.453	19	Thu, 9 May 2024 03:14	Loading...	View
36	mohanty	0.000	0.000	0.000	0.000	1.000	8	Mon, 1 Apr 2024 20:20	Loading...	View
36	MasterSkywalker	0.000	0.000	0.000	0.000	1.000	4	Mon, 8 Apr 2024 12:28	Loading...	View
36	Biaoer	0.000	0.000	0.000	0.000	1.000	42	Tue, 9 Apr 2024 06:56	Loading...	View
36	NWPU-D	0.000	0.000	0.000	0.000	1.000	3	Thu, 11 Apr 2024 08:13	Loading...	View
36	wu_yun_jin	0.000	0.000	0.000	0.000	1.000	9	Sat, 13 Apr 2024 15:48	Loading...	View
36	NTU-MIR-LAB	0.000	0.000	0.000	0.000	1.000	32	Tue, 16 Apr 2024 05:41	Loading...	View
36	canbin_huang7	0.000	0.000	0.000	0.000	1.000	4	Wed, 17 Apr 2024 08:48	Loading...	View
36	int21h	0.000	0.000	0.000	0.000	1.000	5	Thu, 18 Apr 2024 12:07	Loading...	View
36	NTT-DOCOMO-LABS	0.000	0.000	0.000	0.000	1.000	21	Mon, 22 Apr 2024 06:45	Loading...	View
36	pinchos	0.000	0.000	0.000	0.000	1.000	17	Mon, 22 Apr 2024 07:47	Loading...	View
36	teal0range	0.000	0.000	0.000	0.000	1.000	3	Mon, 22 Apr 2024 09:30	Loading...	View
36	T4-takusan-hosii	0.000	0.000	0.000	0.000	1.000	4	Tue, 23 Apr 2024 09:02	Loading...	View
36	ChrisTeam	0.000	0.000	0.000	0.000	1.000	6	Wed, 24 Apr 2024 01:56	Loading...	View
36	TTTry	0.000	0.000	0.000	0.000	1.000	45	Wed, 24 Apr 2024 07:20	Loading...	View
36	ElectricSheep	0.000	0.000	0.000	0.000	1.000	12	Wed, 24 Apr 2024 10:24	Loading...	View