Loading
0 Follower
0 Following
tabularisi
Team ISI

Organization

Information Sciences Institute, USC

Location

Marina del Rey, US

Badges

2
1
1

Activity

Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Mon
Wed
Fri

Ratings Progression

Loading...

Challenge Categories

Loading...

Challenges Entered

Sample-efficient reinforcement learning in Minecraft

Latest submissions

No submissions made in this challenge.

Latest submissions

See All
graded 19478
graded 19471
graded 19455

Latest submissions

See All
graded 20641
graded 20638
graded 20633

Latest submissions

See All
graded 19458
graded 19233
graded 19219
Participant Rating
Participant Rating
tabularisi has not joined any teams yet...

ISWC 2019 Cell-Entity Annotation (CEA) Challenge

Scoring algorithm scores correct answers as incorrect

Almost 5 years ago

I wonder if others have seen this problem. For example, in the airports dataset, we submit <http://dbpedia.org/resource/Heathrow_Airport> and it gets scored as incorrect. Only <http://dbpedia.org/resource/London_Heathrow_Airport> gets scored as correct, even though when you put it in the browser it redirects to http://dbpedia.org/page/Heathrow_Airport.

The following query shows many other URIs that would be correct answers (in addition to some incorrect ones :frowning:

SELECT * WHERE {
  ?s <http://dbpedia.org/ontology/wikiPageRedirects> <http://dbpedia.org/resource/Heathrow_Airport> . 
} 

Has anyone else faced this problem? Any suggestions on how to work around it?

Thanks

tabularisi has not provided any information yet.