Final Evaluation Process & Team Scores

Thank you for reply.
I understand, I just misunderstand task2 and task3 task name.

View post 1

📢 Submit Your Technical Report and Poster by July 25 **Submission Link Updated**

Thanks! host reply me and I understand situation

View post 0

📢 Submit Your Technical Report and Poster by July 25 **Submission Link Updated**

Hi Admins, @snehananavati @yilun_jin8 @Jiaqi
How about presentation conditions? or not presentation?
we will write a technical report. we need to proceed a preparation of material in parallel.

Furthermore, I’m looking forward to answer from yours

View post 0

🏆 Meta CRAG Challenge 2025 Winners Announcement

Thank you for paper and poster announcement

View post 0

Final Evaluation Process & Team Scores

@snehananavati @yilun_jin @Jiaqi
Thank you for sharing the detail result.
This is tereka team member of AcroYAMALEX

my submission ID 289902 is Task3 submission ID.
so I check more other teams, 289355(Team_NVIDIA) is task3, 289655(db3) is task2

Do you exchange result task2 and task3?

View post 0

🏆 Meta CRAG Challenge 2025 Winners Announcement

@snehananavati @yilun_jin8 @Jiaqi
Hi,admins.
How about these questions in this thread?
We need to prepare submission of paper, presentation and poster, if we meet a conditions.
I’m looking forward to your response.

View post 2

🏆 Meta CRAG Challenge 2025 Winners Announcement

Thank you for sharing of final result.
Which submission did you choice in prize?, all team write 2 submission ids in google form.
I would like to a submit paper, but I don’t know that which one.

View post 1

Why #288766 is failed?

@yilun_jin8 @jyotish
I also just get other error. why error?

View post 0

Why #288766 is failed?

@yilun_jin8 @jyotish
Hello admins.
why this submission failed? I can’t see logs.
message is at the first time(pod deleted during operation Check the submission page for more details.)

View post 0

Why submission #288163 stopped?

@jyotish
Did you already re-submit?
I can’t see re-submit result.

View post 0

Why submission #288163 stopped?

Thank you for checking.
please re-submit this submission.

View post 0

Why submission #288163 stopped?

@yilun_jin8 @jyotish
Hello admins.
I submit this, but it’s stopped.
why this submission stopped?
it passed validation step, but prediction stopped for a long time.

View post 0

Important Update on Missing/Refusal Rate

@Jiaqi
Please explain about detail of your evaluation announcement.

1. In Single-Source Augmentation almost team missing score is over 90%.
   (e.g. my team have almost 91% missing)
   Almost team disqualified in Single-Source Augmentation in now in human eval metrics. is that correct?

2. Please tell us the approximate missing rate.
   Without a benchmark, I can’t know whether the model I’ve trained is good enough.

View post 4

Why Submission #288026 failed?

Thanks, I just check this score.

View post 0

Why Submission #288026 failed?

@yilun_jin8 @jyotish
Hello, admins.
Why this submission is failed?
it submission progress stop on 21%… Do I need to set timeout to get html handling?

Thanks.

View post 0

Can we submit a stable solution to the competition?

Thank you for information and adjustment of possible compentations.

View post 0

Can we submit a stable solution to the competition?

@jyotish
Thank you for reply.
I’m waiting for host announcement about re-evaluation process.

how about this?

When will host announce about possible compensation?

View post 0

Can we submit a stable solution to the competition?

@yilun_jin8
Hello.I would like to confirm about these problems.

1. When will the API be fixed?, I will submit my solution in Phase2/3
2. When will host announce about possible compensation?

View post 0

Can we submit a stable solution to the competition?

Thanks, I completely understand.
I’m waiting for v0.6 fixed version about Multi Turn/Multi Source.

View post 0

Can we submit a stable solution to the competition?

Hi @yilun_jin8
Thank you for reply.
I understand situation at now.

For your information, we can submit Single-Source Augmentation,
but we cannot submit others because of cragmm_search index v0.6 None Exception. Is that correct?

View post 0