AIcrowd | Meta CRAG - MM Challenge 2025 | Leaderboards

Loading

Warm-Up Round: Completed

Round 1: Completed

Round 2: Completed #multi_modal #multi_turn

By

105.4k

890

256

4925

‼️Select your final submissions for evaluation by 23 June 2025, 12:00 UTC

db3

5.0

Loading...

Dianping-Trust-Safety

6.0

Loading...

BlackPearl

7.0

Loading...

Leaderboard filters

Show Scores

Δ	#	Participants	Score	Submission Trend	Single-source Augmentation Weight: 1.0	Multi-turn QA Weight: 1.0	Multi-source Augmentation Weight: 1.0
	01	db3	5.000	Loading...	2 0.053	2 0.172	0.124
	02	Dianping-Trust-Safety	6.000	Loading...	0.073	3 0.121	2 0.119
	03	BlackPearl	7.000	Loading...	3 0.043	0.175	3 0.107
	04	Team_NVIDIA	14.000	Loading...	6 0.026	4 0.119	4 0.075
	05	y3h2	18.000	Loading...	4 0.036	5 0.104	9 0.034
	06	SpeedSearcher	22.000	Loading...	8 0.022	9 0.084	5 0.06
	07	zmf	24.000	Loading...	9 0.019	8 0.088	7 0.051
	07	AcroYAMALEX	24.000	Loading...	12 0.016	6 0.1	6 0.057
	08	otonadake	26.000	Loading...	7 0.026	11 0.076	8 0.04
	09	USTGZ-KIMI	27.000	Loading...	5 0.029	12 0.074	10 0.024
	10	NEC_AI_ROCKETS	36.000	Loading...	13 0.016	10 0.079	13 0.015
	11	gogoogo	43.000	Loading...	16 0.01	16 0.057	11 0.023
	12	HiTech	47.000	Loading...	18 0.008	14 0.067	15 0.014
	13	TieMoJi	49.000	Loading...	11 0.016	22 0.045	16 0.011
	14	ntamura	54.000	Loading...	21 0.004	19 0.051	14 0.014
	15	cruise	59.000	Loading...	14 0.013	7 0.088	38 -0.078
	16	Hairuo	65.000	Loading...	27 0.002	21 0.047	17 0.007
	17	LlamaLambda	73.000	Loading...	26 0.002	25 0.035	22 0.0
	18	AIIIN[-C	77.000	Loading...	24 0.003	33 0.001	20 0.002
	18	Aha	77.000	Loading...	28 0.001	20 0.047	29 -0.007
	19	MOKKA	80.000	Loading...	22 0.004	31 0.003	27 -0.006
	20	LYYTest	91.000	Loading...	46 -0.028	24 0.039	21 0.002
	21	Camaro	92.000	Loading...	44 -0.013	17 0.055	31 -0.029
	22	hsoh	93.000	Loading...	35 -0.001	30 0.008	28 -0.006
	23	SuperIkun	95.000	Loading...	42 -0.009	27 0.027	26 -0.005
	24	liurui	102.000	Loading...	55 -0.219	13 0.07	34 -0.05
	25	abc2025team	103.000	Loading...	48 -0.031	23 0.041	32 -0.036
	26	Future	105.000	Loading...	47 -0.029	28 0.025	30 -0.028
	27	NJUST-KMG	110.000	Loading...	20 0.008	-	12 0.015
	28	Terminal	112.000	Loading...	10 0.017	-	24 0.0
	29	v_stappn	114.000	Loading...	17 0.01	-	19 0.002
	30	ETSLab	119.000	Loading...	23 0.004	-	18 0.003
	31	multi	122.000	Loading...	57 -0.263	29 0.016	36 -0.055
	32	KMTDSG	123.000	Loading...	37 -0.002	32 0.002	54 -1.0
	32	taylor	123.000	Loading...	39 -0.004	39 -0.034	45 -0.22
	33	UniqueData	126.000	Loading...	38 -0.003	42 -0.045	46 -0.244
	33	ldl	126.000	Loading...	-	15 0.059	33 -0.036
	34	tt_alone	131.000	Loading...	15 0.011	38 -0.033	-
	34	mm	131.000	Loading...	-	18 0.054	35 -0.052
	35	wandou	132.000	Loading...	66 -0.6	26 0.035	40 -0.119
	36	Maple	135.000	Loading...	32 0.0	-	25 0.0
	36	GAO	135.000	Loading...	58 -0.298	36 -0.025	41 -0.139
	37	leooooeo	141.000	Loading...	29 0.0	34 0.0	-
	37	D2KLab	141.000	Loading...	54 -0.205	43 -0.081	44 -0.176
	38	Metamorphosis	150.000	Loading...	60 -0.339	41 -0.041	49 -0.279
	39	ni_kai_hua	155.000	Loading...	29 0.0	-	48 -0.275
	40	zhan	160.000	Loading...	-	35 -0.017	47 -0.252
	40	Team4	160.000	Loading...	-	40 -0.041	42 -0.144
	41	KDD-2025	161.000	Loading...	61 -0.34	-	22 0.0
	42	evan	174.000	Loading...	45 -0.027	-	51 -0.452