AIcrowd | Meta KDD Cup 24 - CRAG - Retrieval Summarization

Round 1: Completed

Round 1b: Completed

Phase 2: Completed #knowledge_graph #llm #knowledge_retrieval #question_answering_systems #retrieval_summarization Weight: 1.0

Meta

26.6k

2995

384

4390

db3

0.246

dRAGonRAnGers

0.165

TieMoJi 0.129

Leaderboard filters

Clear Filter

Include post-challenge submissions

#	Participants	🌟 CRAG Score	🎯 Exact Accuracy	🔍 Accuracy	🌀 Hallucination	❓ Missing	🕒	Entries	Last Submission	Submission Trend
01	db3	0.246	0.282	0.408	0.162	0.429	13.748	26	Fri, 31 May 2024 15:37	Loading...	View
02	dRAGonRAnGers	0.165	0.162	0.285	0.120	0.595	11.351	72	Mon, 20 May 2024 23:18	Loading...	View
03	TieMoJi	0.129	0.237	0.351	0.222	0.426	6.067	22	Fri, 31 May 2024 08:49	Loading...	View
04	StarTeam	0.123	0.114	0.261	0.138	0.601	1.126	25	Thu, 6 Jun 2024 11:48	Loading...	View
05	5the4th	0.114	0.057	0.213	0.099	0.688	6.695	27	Sun, 2 Jun 2024 04:42	Loading...	View
05	md_dh	0.114	0.141	0.180	0.066	0.754	8.278	19	Tue, 4 Jun 2024 01:27	Loading...	View
07	ElectricSheep	0.111	0.120	0.243	0.132	0.625	13.507	23	Thu, 6 Jun 2024 18:25	Loading...	View
08	taylor	0.105	0.015	0.252	0.147	0.601	4.742	17	Wed, 22 May 2024 07:23	Loading...	View
09	hnu_LH	0.090	0.030	0.216	0.126	0.658	10.971	55	Sun, 26 May 2024 03:03	Loading...	View
10	DMIR	0.087	0.090	0.234	0.147	0.619	6.028	23	Thu, 23 May 2024 09:28	Loading...	View
10	LexiXu	0.087	0.000	0.129	0.042	0.829	6.774	15	Mon, 27 May 2024 14:13	Loading...	View
12	crag	0.084	0.012	0.231	0.147	0.622	4.468	11	Tue, 21 May 2024 03:55	Loading...	View
13	APEX	0.072	0.042	0.141	0.069	0.790	5.852	16	Fri, 24 May 2024 06:22	Loading...	View
13	bumblebee7	0.072	0.000	0.186	0.114	0.700	7.825	6	Thu, 30 May 2024 13:10	Loading...	View
13	Future	0.072	0.120	0.147	0.075	0.778	3.995	13	Wed, 5 Jun 2024 05:09	Loading...	View
16	NTT-DOCOMO-LABS	0.063	0.087	0.087	0.024	0.889	0.168	4	Mon, 27 May 2024 16:58	Loading...	View
17	li_mark	0.054	0.006	0.228	0.174	0.598	0.735	8	Sun, 26 May 2024 09:54	Loading...	View
18	Anti	0.045	0.069	0.270	0.225	0.505	6.352	26	Fri, 24 May 2024 04:16	Loading...	View
18	nicholas_liu	0.045	0.087	0.237	0.192	0.571	5.694	19	Fri, 31 May 2024 23:56	Loading...	View
20	Riviera4	0.039	0.039	0.189	0.150	0.661	11.081	5	Thu, 16 May 2024 11:16	Loading...	View
20	DarkSouls	0.039	0.018	0.114	0.075	0.811	1.294	10	Fri, 17 May 2024 03:16	Loading...	View
22	STAIR	0.036	0.057	0.261	0.225	0.514	5.189	26	Mon, 27 May 2024 11:10	Loading...	View
22	AIFIRST	0.036	0.000	0.087	0.051	0.862	5.013	23	Thu, 6 Jun 2024 22:34	Loading...	View
24	D5MumboJumbo	0.033	0.042	0.168	0.135	0.697	1.150	1	Wed, 22 May 2024 13:02	Loading...	View
24	Tatter	0.033	0.000	0.174	0.141	0.685	17.627	15	Sat, 25 May 2024 13:16	Loading...	View
26	jax_yu	0.030	0.135	0.246	0.216	0.538	4.671	28	Tue, 28 May 2024 09:04	Loading...	View
27	jjplane	0.027	0.000	0.099	0.072	0.829	5.137	8	Fri, 17 May 2024 10:00	Loading...	View
28	iLearn	0.021	0.111	0.267	0.246	0.486	2.787	11	Wed, 22 May 2024 08:24	Loading...	View
28	AC	0.021	0.015	0.042	0.021	0.937	2.968	11	Sun, 26 May 2024 17:04	Loading...	View
30	gylin_cmu	0.015	0.048	0.114	0.099	0.787	3.649	17	Fri, 24 May 2024 10:22	Loading...	View
30	yly01	0.015	0.012	0.213	0.198	0.589	4.814	27	Sat, 25 May 2024 05:24	Loading...	View
30	ruleisallyouneed	0.015	0.006	0.129	0.114	0.757	9.466	8	Fri, 31 May 2024 07:51	Loading...	View
30	T4-takusan-hosii	0.015	0.009	0.225	0.210	0.565	2.576	40	Thu, 6 Jun 2024 07:45	Loading...	View
34	Memento	0.012	0.021	0.231	0.219	0.550	4.137	14	Thu, 30 May 2024 03:34	Loading...	View
35	ETSLab	0.009	0.090	0.300	0.291	0.408	7.961	12	Wed, 29 May 2024 06:01	Loading...	View
36	pinchos	0.006	0.003	0.021	0.015	0.964	2.541	32	Mon, 20 May 2024 08:17	Loading...	View
36	s.z	0.006	0.006	0.009	0.003	0.988	0.067	3	Tue, 21 May 2024 14:01	Loading...	View
36	R-Pioneers	0.006	0.018	0.240	0.234	0.526	7.740	10	Thu, 23 May 2024 03:11	Loading...	View
36	vslyu-team	0.006	0.006	0.009	0.003	0.988	0.064	19	Fri, 24 May 2024 09:23	Loading...	View
40	Equestrians	0.003	0.015	0.078	0.075	0.847	5.691	35	Tue, 21 May 2024 16:41	Loading...	View
41	mohanty	0.000	0.000	0.000	0.000	1.000	-	4	Wed, 15 May 2024 00:16	Loading...	View
41	crazyRAG	0.000	0.000	0.000	0.000	1.000	-	1	Wed, 15 May 2024 08:04	Loading...	View
41	Ssrhgjz	0.000	0.000	0.000	0.000	1.000	0.065	13	Thu, 16 May 2024 01:36	Loading...	View
41	Hermes	0.000	0.000	0.000	0.000	1.000	0.067	1	Thu, 16 May 2024 03:53	Loading...	View
41	study_RAG	0.000	0.000	0.000	0.000	1.000	0.065	1	Thu, 16 May 2024 07:53	Loading...	View
41	tensorboy_go	0.000	0.000	0.000	0.000	1.000	0.066	1	Fri, 17 May 2024 08:52	Loading...	View
41	yong_deng4	0.000	0.000	0.000	0.000	1.000	0.065	1	Fri, 17 May 2024 15:18	Loading...	View
41	Biaoer	0.000	0.000	0.000	0.000	1.000	0.062	6	Sat, 18 May 2024 14:22	Loading...	View
41	Olive_0	0.000	0.000	0.000	0.000	1.000	0.064	2	Mon, 20 May 2024 04:54	Loading...	View
41	SPML_MIR	0.000	0.000	0.000	0.000	1.000	0.068	1	Mon, 20 May 2024 04:55	Loading...	View