Location
Badges
Activity
Ratings Progression
Challenge Categories
Challenges Entered
Improve RAG with Real-World Benchmarks
Latest submissions
See Allgraded | 266335 | ||
graded | 266193 | ||
graded | 266168 |
A benchmark for image-based food recognition
Latest submissions
Classify images of snake species from around the world
Latest submissions
See Allgraded | 10024 | ||
graded | 6995 | ||
failed | 6992 |
5 Problems 15 Days. Can you solve it all?
Latest submissions
See Allgraded | 74031 | ||
graded | 73938 | ||
graded | 73831 |
Disentanglement: from simulation to real-world
Latest submissions
A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning
Latest submissions
Latest submissions
See Allgraded | 73807 | ||
graded | 73198 | ||
graded | 72790 |
Testing RAG Systems with Limited Web Pages
Latest submissions
See Allgraded | 266167 | ||
failed | 266122 | ||
failed | 265909 |
Evaluating RAG Systems With Mock KGs and APIs
Latest submissions
See Allgraded | 266168 | ||
failed | 266069 | ||
graded | 266068 |
Enhance RAG systems With Multiple Web Sources & Mock API
Latest submissions
See Allgraded | 266335 | ||
graded | 266193 | ||
failed | 266166 |
Participant | Rating |
---|---|
alchemi01 | 235 |
Participant | Rating |
---|
Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937
Did somebody try deploy three llama3-8b on four T4?
4 months agoHow large is each llama3-8b model? If it is 16GB each, itβs possible.
Whether the task test phase can link to the Internet
4 months agoThere is the Internet when building the Docker image. But no internet when they run submissions.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
4 months agoThe docker file can be customized. It is the environment to run the code in gitlab.
The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?
5 months agoLook at crag_mock_api/apiwrapper/pycragapi.py
to see how to use its functions.
The openai interface cannot be used during evaluation? Why?
5 months agoYou need to pass API key. There is also no internet in the submission.
Added tag with "submission-v" prefix but no evaluation issue created
5 months agoGot this issue again.
When will the submission limit be reset?
5 months agoIn the Submission tab of the main challenge page, we can see how many submissions are left this week.
Is anyone using Colab for this competition?
5 months agoYou can use Colab, but having a local GPU is more convenient for debugging and checking submission
Meta KDD Cup 24 - CRAG - Retrieval Summarization
Failed to communicate with the grader
4 months agoI had the same issue. Is it fixed now? @aicrowd_team
Couldn't instantiate the backend tokenizer
5 months agoHave you tried installing the transformer package?
About Test Set Leakage in Round 1
5 months ago@aicrowd_team I suggest that the Round 2 test set should be truly private and not share any similarity or distribution with the data in Round 1.
Why am I not eligible to participate?
5 months agoI have tried again and still failed with the same reason
MASKD
MMdetection unable to form final test file
About 4 years agoLooking at the starter/baseline code. Thereβs the example for preparing the submission.
CHESS
About the dataset
About 4 years agoThanks for the reply.
I make another submission without external data. However, the leaderboard doesnβt seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348
Is it ok to make submission now? @ashivani
Did somebody try deploy three llama3-8b on four T4?
4 months agoThere are 4 T4 cards. But I see that the total GPU memory is < 60GB.