Loading
1 Follower
0 Following
liberifatali

Location

VN

Badges

3
1
1

Activity

Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Improve RAG with Real-World Benchmarks

Latest submissions

See All
graded 266335
graded 266193
graded 266168

A benchmark for image-based food recognition

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 10024
graded 6995
failed 6992

5 Problems 15 Days. Can you solve it all?

Latest submissions

See All
graded 74031
graded 73938
graded 73831

Latest submissions

No submissions made in this challenge.

A new benchmark for Artificial Intelligence (AI) research in Reinforcement Learning

Latest submissions

No submissions made in this challenge.

Real Time Mask Detection

Latest submissions

See All
graded 73807
graded 73198
graded 72790

Testing RAG Systems with Limited Web Pages

Latest submissions

See All
graded 266167
failed 266122
failed 265909

Evaluating RAG Systems With Mock KGs and APIs

Latest submissions

See All
graded 266168
failed 266069
graded 266068

Enhance RAG systems With Multiple Web Sources & Mock API

Latest submissions

See All
graded 266335
graded 266193
failed 266166
Participant Rating
alchemi01 235
Participant Rating

Meta Comprehensive RAG Benchmark: KDD Cup 2-9d1937

Did somebody try deploy three llama3-8b on four T4?

4 months ago

There are 4 T4 cards. But I see that the total GPU memory is < 60GB.

Did somebody try deploy three llama3-8b on four T4?

4 months ago

How large is each llama3-8b model? If it is 16GB each, it’s possible.

Whether the task test phase can link to the Internet

4 months ago

There is the Internet when building the Docker image. But no internet when they run submissions.

The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?

4 months ago

The docker file can be customized. It is the environment to run the code in gitlab.

The CRAG-Mock-API should move to the Meta Comphrehensive RAG Benchmark starter kit project?

5 months ago

Look at crag_mock_api/apiwrapper/pycragapi.py to see how to use its functions.

The openai interface cannot be used during evaluation? Why?

5 months ago

You need to pass API key. There is also no internet in the submission.

How can I delete my LFS?

5 months ago

I had to delete the local repo to solve this.

When will the submission limit be reset?

5 months ago

In the Submission tab of the main challenge page, we can see how many submissions are left this week.

Usage of GGUF and finetuned LLaMA Models

5 months ago

I have the same question @mohanty

Is anyone using Colab for this competition?

5 months ago

You can use Colab, but having a local GPU is more convenient for debugging and checking submission

Meta KDD Cup 24 - CRAG - Retrieval Summarization

Failed to communicate with the grader

4 months ago

I had the same issue. Is it fixed now? @aicrowd_team

Couldn't instantiate the backend tokenizer

5 months ago

Have you tried installing the transformer package?

About Test Set Leakage in Round 1

5 months ago

@aicrowd_team I suggest that the Round 2 test set should be truly private and not share any similarity or distribution with the data in Round 1.

Why am I not eligible to participate?

5 months ago

I have tried again and still failed with the same reason

Why am I not eligible to participate?

5 months ago

I got the same issue

CUDA out of memory issue

5 months ago

What’s in the debug log?

MASKD

MMdetection unable to form final test file

About 4 years ago

Looking at the starter/baseline code. There’s the example for preparing the submission.

CHESS

About the dataset

About 4 years ago

Thanks for the reply.

I make another submission without external data. However, the leaderboard doesn’t seem to be updated:
https://www.aicrowd.com/challenges/aicrowd-blitz-2/problems/chess/submissions/73348

Is it ok to make submission now? @ashivani

A starfruit's worth, the golden prize. Three-span pouch holds, a fortune's rise.