AIcrowd | Meta CRAG - MM Challenge 2025 | Leaderboards

Loading

Warm-Up Round: Completed

Round 1: Completed

Round 2: Completed #multi_modal #multi_turn

By

130.9k

1000

256

4927

‼️Select your final submissions for evaluation by 23 June 2025, 12:00 UTC

db3

5.0

Loading...

Dianping-Trust-Safety

6.0

Loading...

BlackPearl

7.0

Loading...

Leaderboard filters

Show Scores

Δ	#	Participants	Score	Submission Trend	Single-source Augmentation Weight: 1.0	Multi-turn QA Weight: 1.0	Multi-source Augmentation Weight: 1.0
	01	db3	5.000	Loading...	2 0.053	2 0.172	0.124
	02	Dianping-Trust-Safety	6.000	Loading...	0.073	3 0.121	2 0.119
	03	BlackPearl	7.000	Loading...	3 0.043	0.175	3 0.107
	04	Team_NVIDIA	14.000	Loading...	6 0.026	4 0.119	4 0.075
	05	y3h2	18.000	Loading...	4 0.036	5 0.104	9 0.034
	06	AcroYAMALEX	23.000	Loading...	12 0.016	6 0.1	5 0.057
	06	zmf	23.000	Loading...	9 0.019	8 0.088	6 0.051
	07	SpeedSearcher	24.000	Loading...	8 0.022	9 0.084	7 0.044
	08	otonadake	26.000	Loading...	7 0.026	11 0.076	8 0.04
	09	USTGZ-KIMI	27.000	Loading...	5 0.029	12 0.074	10 0.024
	10	NEC_AI_ROCKETS	36.000	Loading...	13 0.016	10 0.079	13 0.015
	11	gogoogo	43.000	Loading...	16 0.01	16 0.057	11 0.023
	12	HiTech	46.000	Loading...	18 0.008	14 0.067	14 0.014
	13	TieMoJi	48.000	Loading...	11 0.016	22 0.045	15 0.011
	14	ntamura	57.000	Loading...	21 0.004	19 0.051	17 0.004
	15	cruise	59.000	Loading...	14 0.013	7 0.088	38 -0.078
	16	Hairuo	64.000	Loading...	27 0.002	21 0.047	16 0.007
	17	LlamaLambda	73.000	Loading...	26 0.002	25 0.035	22 0.0
	18	AIIIN[-C	77.000	Loading...	24 0.003	33 0.001	20 0.002
	18	Aha	77.000	Loading...	28 0.001	20 0.047	29 -0.007
	19	MOKKA	80.000	Loading...	22 0.004	31 0.003	27 -0.006
	20	LYYTest	89.000	Loading...	44 -0.028	24 0.039	21 0.002
	21	Camaro	90.000	Loading...	42 -0.013	17 0.055	31 -0.029
	22	hsoh	92.000	Loading...	34 -0.001	30 0.008	28 -0.006
	23	SuperIkun	93.000	Loading...	40 -0.009	27 0.027	26 -0.005
	24	liurui	100.000	Loading...	53 -0.219	13 0.07	34 -0.05
	25	abc2025team	101.000	Loading...	46 -0.031	23 0.041	32 -0.036
	26	Future	103.000	Loading...	45 -0.029	28 0.025	30 -0.028
	27	NJUST-KMG	107.000	Loading...	20 0.008	-	12 0.015
	28	Terminal	109.000	Loading...	10 0.017	-	24 0.0
	29	v_stappn	111.000	Loading...	17 0.01	-	19 0.002
	30	ETSLab	116.000	Loading...	23 0.004	-	18 0.003
	30	ETSLab	116.000	Loading...	23 0.004	-	18 0.003
	31	multi	120.000	Loading...	55 -0.263	29 0.016	36 -0.055
	31	multi	120.000	Loading...	55 -0.263	29 0.016	36 -0.055
	32	taylor	122.000	Loading...	38 -0.004	39 -0.034	45 -0.22
	32	KMTDSG	122.000	Loading...	36 -0.002	32 0.002	54 -1.0
	32	KMTDSG	122.000	Loading...	36 -0.002	32 0.002	54 -1.0
	32	taylor	122.000	Loading...	38 -0.004	39 -0.034	45 -0.22
	33	ldl	123.000	Loading...	-	15 0.059	33 -0.036
	33	ldl	123.000	Loading...	-	15 0.059	33 -0.036
	34	UniqueData	125.000	Loading...	37 -0.003	42 -0.045	46 -0.244
	34	UniqueData	125.000	Loading...	37 -0.003	42 -0.045	46 -0.244
	35	tt_alone	128.000	Loading...	15 0.011	38 -0.033	-
	35	wandou	128.000	Loading...	62 -0.6	26 0.035	40 -0.119
	35	wandou	128.000	Loading...	62 -0.6	26 0.035	40 -0.119
	35	tt_alone	128.000	Loading...	15 0.011	38 -0.033	-
	35	mm	128.000	Loading...	-	18 0.054	35 -0.052
	35	mm	128.000	Loading...	-	18 0.054	35 -0.052
	36	Maple	132.000	Loading...	32 0.0	-	25 0.0