Loading
0 Follower
0 Following
yukiko08

Location

JP

Badges

0
0
0

Activity

Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri

Challenge Categories

Loading...

Challenges Entered

Improve RAG with Real-World Benchmarks | KDD Cup 2025

Latest submissions

See All
failed 289835
failed 289478
failed 289363

Generating answers using image-linked data

Latest submissions

See All
failed 282546

Synthesising answers from image and web sources

Latest submissions

See All
graded 286760
submitted 286502

Contextual answering in multi-turn dialogue

Latest submissions

See All
failed 289835
failed 289478
failed 289363
Participant Rating
Participant Rating

Meta CRAG - MM Challenge 2025

Status was changed after submission

6 months ago

My submission of task 3 was successful before, but when I checked it today, it is โ€œFailedโ€. Why is that?

################
Evaluation failed with exit code 1

[rank0]: Traceback (most recent call last):
[rank0]: File โ€œ<private_file>โ€, line 211, in
[rank0]: raise exc
[rank0]: File โ€œ<private_file>โ€, line 196, in
[rank0]: main()
[rank0]: File โ€œ<private_file>โ€, line 189, in main
[rank0]: serve()
[rank0]: File โ€œ<private_file>โ€, line 176, in serve
[rank0]: oracle_client.run_agent()
[rank0]: File โ€œ<private_file>โ€, line 269, in run_agent
[rank0]: self._agent_executor()
[rank0]: File โ€œ<private_file>โ€, line 323, in _agent_executor
[rank0]: result = self.execute(target_attribute, *args, **kwargs)
[rank0]: File โ€œ<private_file>โ€, line 173, in execute
[rank0]: return method(*args, **kwargs)
[rank0]: File โ€œ<private_file>โ€, line 123, in batch_generate_response
[rank0]: return run_with_timeout(
[rank0]: File โ€œ<private_file>โ€, line 159, in run_with_timeout
[rank0]: return fn(*args, **kwargs)
[rank0]: File โ€œ<private_file>โ€, line 327, in batch_generate_response
[rank0]: rag_inputs = self.prepare_rag_enhanced_inputs(
[rank0]: File โ€œ<private_file>โ€, line 227, in prepare_rag_enhanced_inputs
[rank0]: results = self.search_pipeline(<private_test_file>, k=<sensitive_data>)
[rank0]: File โ€œ/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.pyโ€, line 1431, in call
[rank0]: return self.run_single(inputs, preprocess_params, forward_params, postprocess_params)
[rank0]: File โ€œ/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.pyโ€, line 1439, in run_single
[rank0]: outputs = self.postprocess(model_outputs, **postprocess_params)
[rank0]: File โ€œ/usr/local/lib/python3.10/site-packages/cragmm_search/search.pyโ€, line 186, in postprocess
[rank0]: return [
[rank0]: File โ€œ/usr/local/lib/python3.10/site-packages/cragmm_search/search.pyโ€, line 187, in
[rank0]: {
[rank0]: TypeError: โ€˜<redacted_value>โ€™ object is not a mapping
[rank0]:[W603 21:40:11.975361850 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources.

yukiko08 has not provided any information yet.