
0 Follower
0 Following
yukiko08
Location
Badges
0
0
0
Activity
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Mon
Wed
Fri
Challenge Categories
Loading...
Challenges Entered
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See All| failed | 289835 | ||
| failed | 289478 | ||
| failed | 289363 |
Synthesising answers from image and web sources
Latest submissions
See All| graded | 286760 | ||
| submitted | 286502 |
Contextual answering in multi-turn dialogue
Latest submissions
See All| failed | 289835 | ||
| failed | 289478 | ||
| failed | 289363 |
| Participant | Rating |
|---|
| Participant | Rating |
|---|
Meta CRAG - MM Challenge 2025
yukiko08 has not provided any information yet.
Status was changed after submission
6 months agoMy submission of task 3 was successful before, but when I checked it today, it is โFailedโ. Why is that?
################
Evaluation failed with exit code 1
[rank0]: Traceback (most recent call last):
[rank0]: File โ<private_file>โ, line 211, in
[rank0]: raise exc
[rank0]: File โ<private_file>โ, line 196, in
[rank0]: main()
[rank0]: File โ<private_file>โ, line 189, in main
[rank0]: serve()
[rank0]: File โ<private_file>โ, line 176, in serve
[rank0]: oracle_client.run_agent()
[rank0]: File โ<private_file>โ, line 269, in run_agent
[rank0]: self._agent_executor()
[rank0]: File โ<private_file>โ, line 323, in _agent_executor
[rank0]: result = self.execute(target_attribute, *args, **kwargs)
[rank0]: File โ<private_file>โ, line 173, in execute
[rank0]: return method(*args, **kwargs)
[rank0]: File โ<private_file>โ, line 123, in batch_generate_response
[rank0]: return run_with_timeout(
[rank0]: File โ<private_file>โ, line 159, in run_with_timeout
[rank0]: return fn(*args, **kwargs)
[rank0]: File โ<private_file>โ, line 327, in batch_generate_response
[rank0]: rag_inputs = self.prepare_rag_enhanced_inputs(
[rank0]: File โ<private_file>โ, line 227, in prepare_rag_enhanced_inputs
[rank0]: results = self.search_pipeline(<private_test_file>, k=<sensitive_data>)
[rank0]: File โ/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.pyโ, line 1431, in call
[rank0]: return self.run_single(inputs, preprocess_params, forward_params, postprocess_params)
[rank0]: File โ/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.pyโ, line 1439, in run_single
[rank0]: outputs = self.postprocess(model_outputs, **postprocess_params)
[rank0]: File โ/usr/local/lib/python3.10/site-packages/cragmm_search/search.pyโ, line 186, in postprocess
[rank0]: return [
[rank0]: File โ/usr/local/lib/python3.10/site-packages/cragmm_search/search.pyโ, line 187, in
[rank0]: {
[rank0]: TypeError: โ<redacted_value>โ object is not a mapping
[rank0]:[W603 21:40:11.975361850 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources.