
0 Follower
0 Following
yukiko08
Location
Badges
0
0
0
Activity
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Mon
Wed
Fri
Challenge Categories
Loading...
Challenges Entered
Build an LLM agent for five real-world games
Latest submissions
Improve RAG with Real-World Benchmarks | KDD Cup 2025
Latest submissions
See All| failed | 289835 | ||
| failed | 289478 | ||
| failed | 289363 |
Synthesising answers from image and web sources
Latest submissions
See All| graded | 286760 | ||
| submitted | 286502 |
Contextual answering in multi-turn dialogue
Latest submissions
See All| failed | 289835 | ||
| failed | 289478 | ||
| failed | 289363 |
| Participant | Rating |
|---|
| Participant | Rating |
|---|
Meta CRAG - MM Challenge 2025
yukiko08 has not provided any information yet.
Status was changed after submission
10 months agoMy submission of task 3 was successful before, but when I checked it today, it is “Failed”. Why is that?
################
Evaluation failed with exit code 1
[rank0]: Traceback (most recent call last):
[rank0]: File “<private_file>”, line 211, in
[rank0]: raise exc
[rank0]: File “<private_file>”, line 196, in
[rank0]: main()
[rank0]: File “<private_file>”, line 189, in main
[rank0]: serve()
[rank0]: File “<private_file>”, line 176, in serve
[rank0]: oracle_client.run_agent()
[rank0]: File “<private_file>”, line 269, in run_agent
[rank0]: self._agent_executor()
[rank0]: File “<private_file>”, line 323, in _agent_executor
[rank0]: result = self.execute(target_attribute, *args, **kwargs)
[rank0]: File “<private_file>”, line 173, in execute
[rank0]: return method(*args, **kwargs)
[rank0]: File “<private_file>”, line 123, in batch_generate_response
[rank0]: return run_with_timeout(
[rank0]: File “<private_file>”, line 159, in run_with_timeout
[rank0]: return fn(*args, **kwargs)
[rank0]: File “<private_file>”, line 327, in batch_generate_response
[rank0]: rag_inputs = self.prepare_rag_enhanced_inputs(
[rank0]: File “<private_file>”, line 227, in prepare_rag_enhanced_inputs
[rank0]: results = self.search_pipeline(<private_test_file>, k=<sensitive_data>)
[rank0]: File “/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.py”, line 1431, in call
[rank0]: return self.run_single(inputs, preprocess_params, forward_params, postprocess_params)
[rank0]: File “/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.py”, line 1439, in run_single
[rank0]: outputs = self.postprocess(model_outputs, **postprocess_params)
[rank0]: File “/usr/local/lib/python3.10/site-packages/cragmm_search/search.py”, line 186, in postprocess
[rank0]: return [
[rank0]: File “/usr/local/lib/python3.10/site-packages/cragmm_search/search.py”, line 187, in
[rank0]: {
[rank0]: TypeError: ‘<redacted_value>’ object is not a mapping
[rank0]:[W603 21:40:11.975361850 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources.