Is anyone willing to demo a sample submission?

1. I went to lichess.org open database
2. Downloaded the lichess_db_eval.jsonl.zst file. and unpacked it.
3. Sampled 1% and filtered by some criteria (depth > 25, for instance).
4. Converted to a format of chat messages. In the “user” message, I have basically a prompt from the starter kit. In the “assistant” message, I have …<uci_move></uci_move> format. To fill the template fields in the user message, I used python-chess library.

You can skip all the steps above by just using the datasets from organizers: aicrowd/ChessExplained · Datasets at Hugging Face

5. Then I trained a model. For that, I used my own fine-tuning code on top of Unsloth and Qwen 3 4B as a base model.
6. Uploaded the final fine-tuned model to Huggingface as a gated model.
7. Used this script to create the submission: aicrowd_submit.sh

View post 0

Pokemon map is broken?

This submission, for instance: AIcrowd | Orak Game Agent Challenge 2025 | Submissions #304644

The game clearly started, the menu and initial dialog were passed. The location is RedsHouse1f. From what I can see, one of the problems might be that in the “map_names.json” it is “RedsHouse1F”, not “RedsHouse1f” (with capital F).

The bigger problem in the code is the fact that “pokemon_tools.py” or “pokemon_tools_mcp.py” are not used anywhere at all. Including the “process_state_tool” function that is supposed to replace “?” when the tile is explored. Another side effect of that is that advanced tools (such as “move_to”) are not callable.

View post 0

Pokemon map is broken?

It seems that after the recent evals update, the map is broken both in local and remote modes. Most of the cells are ‘?’. I think before the update, it wasn’t the case.

From the logs:
Map on Screen:\n( 2, 0): ?\t( 3, 0): ?\t( 4, 0): ?\t( 5, 0): ?\t( 6, 0): ?\t( 7, 0): ?\t\n( 2, 1): ?\t( 3, 1): ?\t( 4, 1): ?\t( 5, 1): ?\t( 6, 1): ?\t( 7, 1): ?\t\n( 2, 2): ?\t( 3, 2): ?\t( 4, 2): ?\t( 5, 2): ?\t( 6, 2): ?\t( 7, 2): ?\t\n( 2, 3): ?\t( 3, 3): ?\t( 4, 3): ?\t( 5, 3): ?\t( 6, 3): ?\t( 7, 3): ?\t\n( 2, 4): ?\t( 3, 4): ?\t( 4, 4): ?\t( 5, 4): OBJ_1_1\t( 6, 4): ?\t( 7, 4): ?\t\n( 2, 5): ?\t( 3, 5): ?\t( 4, 5): ?\t( 5, 5): ?\t( 6, 5): ?\t( 7, 5): ?\t\n( 2, 6): ?\t( 3, 6): ?\t( 4, 6): ?\t( 5, 6): ?\t( 6, 6): ?\t( 7, 6): ?

View post 0