CHALLENGE OFFICIAL RULES
PLEASE READ THESE OFFICIAL RULES (“Rules”) CAREFULLY. ENTRY INTO THIS CHALLENGE CONSTITUTES YOUR ACCEPTANCE OF THESE OFFICIAL RULES. IF YOU DO NOT AGREE TO ANY PART OF THESE OFFICIAL RULES, PLEASE DO NOT ENTER THIS CHALLENGE.
NO PURCHASE IS NECESSARY TO ENTER OR WIN. A PURCHASE OF ANY KIND WILL NOT INCREASE YOUR CHANCES OF WINNING. VOID WHERE PROHIBITED.
This Challenge is organized and sponsored by Amazon.com Services LLC, 410 Terry Ave North, Seattle, Washington 98109, USA (“Sponsor”).
2. SPONSOR ADMINS
“Sponsor Admins” are any companies or organizations authorized by Sponsor to aid it with the administration or execution of this Challenge including but not limited to AIcrowd SA.
3. CHALLENGE START AND END DATES (“CHALLENGE PERIOD”)
Start Date: April 16th, 2021
Entry Deadline: September 1st, 2021 at 00:00:00 UTC
Winners Announced: September 30th, 2021
No additional registrations or entries will be accepted after the Entry Deadline. These dates are subject to change at Sponsor’s discretion.
4. PARTICIPATION ELIGIBILITY REQUIREMENTS
You (“Entrant”) are eligible to enter this Challenge if you (and each member of your Team) meet all of the following requirements as of the time and date of entry:
- You are an individual;
- You are 18 years of age or older but in no event less than the age of majority in your place of residence;
- You have Internet Access, an Email Account, and access to a personal computer; and
- You have accurately and truthfully completed the participant registration.
You are only permitted to be part of one Team. Any Entrant that is part of more than one Team may be disqualified and their corresponding Teams may be disqualified as well at the sole discretion of Sponsor.
The Challenge is open to residents of the United States and worldwide, except that if you are a resident of the region of Crimea, Cuba, Iran, Syria, North Korea, Sudan, or are subject to U.S. export controls or sanctions, you may not enter the Challenge. This Challenge is void where prohibited or restricted by law. Sponsor reserves the right to limit or restrict participation in the Challenge to any person at any time for any reason.
People who, during the Challenge Period, are directors, officers, employees, interns, and contractors (“Personnel”) of Sponsor, its parents, subsidiaries, affiliates, and their respective advertising, promotion and public relations agencies, representatives, and agents (collectively, “Challenge Entities”), immediate families members of such Personnel (parents, siblings, children, spouses, and life partners of each) and members of the households of such Personnel (whether related or not) are ineligible to win a prize in this Challenge. Sponsor reserves the right to verify eligibility and adjudicate any eligibility dispute at any time.
It is entirely your responsibility to review and understand your employer’s and country’s policies about your eligibility to participate in this Challenge. If you participate in violation of your employer’s or country’s policies, you and your Entry may be disqualified from the Challenge. Sponsor disclaims any and all liability or responsibility with respect to disputes arising between an employer and such employer’s employee or between a country and its resident in relation to this Challenge.
If any Entrant Team receives any third-party funding primarily intended to facilitate its participation in this Challenge, such funding must be disclosed to Sponsor no later than the Entry Deadline, along with any requirements imposed on the Entrant Team in connection with the funding. Entrant Teams may not accept or use any third-party funding if acceptance or use of that funding, or any requirements imposed in connection with that funding, would conflict with these Official Rules.
By participating in the Challenge, all Entrants unconditionally accept and agree to comply with and abide by these Official Rules and the decisions of the Sponsor which will be final and binding including the Sponsor’s right to verify eligibility, to interpret these Official Rules, and to resolve any disputes relating to this Challenge at any time.
5. IS THE ENTRY AN ELIGIBLE ENTRY?
To be eligible to be considered for a prize, as solely determined by the Sponsor:
The Entry MUST:
- be compatible with the official submission format;
- be in English;
- be the Team’s own original work;
- not have been submitted previously in any promotion of any kind;
- must not use future frames to infer for the current frame (usages of previous frames is allowed);
- not contain material or content that: is inappropriate, indecent, obscene, offensive, sexually explicit, pornographic, hateful, tortious, defamatory, or slanderous or libelous; or promotes bigotry, racism, hatred or harm against any group or individual or promotes discrimination based on race, gender, ethnicity, religion, nationality, disability, sexual orientation, or age; or promotes alcohol, illegal drugs, or tobacco; or violates or infringes another’s rights, including but not limited to rights of privacy, publicity, or their intellectual property rights; or is inconsistent with the message, brand, or image of Sponsor, is unlawful; or is in violation of or contrary to the laws or regulations of any jurisdiction in which the Entry is created; and
The Team members MUST:
- designate one person as the team leader who will be solely responsible for receiving communications from and communicating with Sponsor;
- ensure the Team has obtained any and all consents, approvals, or licenses required for submission of the Entry;
- obtain any consents necessary from all members of the Team with respect to the sharing of such member’s personal information as outlined herein;
- obtain the agreement of all members of the Team to these Rules;
- not engage in false, fraudulent, or deceptive acts at any phase during participation in the Challenge; and
- not tamper or abuse any aspect of this Challenge.
- If you, any Team member, or the Entry is found to be ineligible for any reason, including but not limited to conflicts within Teams and noncompliance with Sections 4 and 5 of these Rules, Sponsor and Sponsor Affiliates reserve the right to disqualify the Entry and/or you and/or your Team members from this Challenge and any other contest or promotional activity sponsored or administered in any way by the Sponsor.
- A participant is not allowed to create more than one account to participate in the challenge. Violating this will result in disqualification from the Challenge.
7. HOW MAY THE ENTRY POTENTIALLY BE USED?
The Entry may be used in a few different ways. Sponsor does not claim to own your Team’s Entry, however, by submitting the Entry you and each member of your Team:
- hereby grants to Sponsor and Sponsor Admins a non-exclusive, irrevocable, royalty-free, world-wide right and license to review and analyze the Entry in relation to this Challenge;
- agrees that each member will execute any necessary paperwork for Sponsor and Sponsor Admins to use the rights and licenses granted hereunder;
- acknowledges and agrees that the Team will not be compensated and may not be credited (at Sponsor’s sole discretion) for the use of the Entry as described in these Rules;
- acknowledges that the Sponsor or Sponsor Admins may have developed or commissioned materials similar to the Entry and waive any claims resulting from any similarities to the Entry;
- understand that the Entry may be posted on a public website or social media channel and that Sponsor is not responsible for any unauthorized use of the Entry by visitors to such site; and
- understand and acknowledge that, subject to provision of Prizes, Sponsor are not obligated to use the Entry in any way, even if the Entry is selected as a winning Entry.
Personal data you submit in relation to this Challenge will be used by Sponsor and Sponsor Admins in accordance to Section 14 of these Rules.
8. HOW WILL WINNERS BE SELECTED AND NOTIFIED?
Teams must upload their inference code to the Sponsor Admin’s platform, which will run inference against the validation set. Submissions will be evaluated first on a smaller subset of flights, and non-meaningful submissions will be discarded without further evaluation and not be posted on the leaderboard. Sponsor maintains right to change the definition of non-meaningful during the Challenge Period based on statistics derived from the highest scoring, previously-submitted entries.
All submissions will be evaluated on the same hardware. A Team may make only one submission per 24-hour period. If a Team makes more than one submission per 24-hour period, only the first submission will be evaluated. If a Team makes more than one submission per 24-hour period on more than one occasion, Sponsor may, at its sole discretion, disqualify the Team. Inference time will be limited to 800s per flight on p3.2xlarge (which can be updated at the sole discretion of the Sponsor).
Winners for the two benchmarks will be determined based on the performance of their submissions on a test dataset based on the metrics computed as described above. As previously outlined, one of the requirements of safe autonomous flight is very low number of false alarms. Any solution that exceeds the available budget of false alarms will not be usable in practice. To encourage realistic solutions and simplify the evaluation, a HFAR budget of 5 false alarm per 10 hours of flight = 0.5 is defined for tracking benchmark and FPPI budget of 0.0005 is defined for the frame level benchmark. Any submission with HFAR > 0.5 / FPPI > 0.0005 will be published on the leaderboard, but not be considered for ranking. All the submissions that have HFAR <= 0.5/ FPPI < 0.0005 will be ranked on the respective leaderboard based on Encounter-Level Detection Rate (EDR) / Average Frame- Leve Detection Rate (AFDR) . Submissions that make use of the provided SIAM-MOT baseline will be considered for ranking only if those submissions use a different model (different weights) which improves EDR by at least 1.5% (that is EDR >= 0.685, AFDR >= 0.6415) and HFAR < 0.5/ FPPI< 0.0005 — improvement of 1.5% in EDR practically means 2 more encounters detected (out of 102) OR Keeps the same EDR = 0.6699 / AFDR = 0.6265 and reduces HFAR/ FPPI by at least 50% (e.g. HFAR <= 0.23, FPPI <= 0.0002).
Qualification criteria for ranking on the private leaderboard is exactly the same as on the public leaderboard.
Participants may elect 2 submissions for each benchmark (total of 4 submissions) to be evaluated for the private leaderboard. Each participant might win at most two prizes, one in each benchmark. If there are no 3 submissions that qualify for a prize in each baseline, the organizers will first award prizes to the submissions that qualify as defined above, for the remainder of prizes, the organizers keep the right to use a different criterion.
Potential winners will be contacted on October 4th, 2021 via the email associated with AIcrowd.com account through which the Entry was submitted. If a potential winner cannot be contacted, does not respond as directed, refuses the prize, or is found to be ineligible for any reason, such prize may be forfeited and awarded to an alternate winner. Only one alternate winner will be selected per each prize package, after which prizes will remain unawarded.
To the extent that there is any dispute as to the identity of the potential winner, the official account holder of the email address associated with the AIcrowd account through which the Entry was first submitted will be deemed the official potential winner by Sponsor.
9. YOUR ODDS OF WINNING
ODDS OF WINNING A PRIZE ARE SUBJECT TO THE TOTAL NUMBER OF ELIGIBLE ENTRIES RECEIVED AND HOW YOUR ENTRY SCORES IN ACCORDANCE TO THE JUDGING CRITERIA.
The top scoring submission for each benchmark will receive $15,000 USD. The second best submission for each benchmark will receive $7,500 USD. The third place submission for each benchmark will receive $1,250 USD. The most “creative” solution as determined by Sponsor’s sole discretion will receive $2,500 USD.
To receive a prize, the Team must make the submission via the AICrowd portal, and submit its training code and a detailed document describing its training process. The description must be written in English, with mathematical formulae as necessary. The description must be written at a level sufficient for a practitioner in computer science to reproduce the results obtained by the Team. It must describe substantially the training and tuning process to reproduce results independently. Failure to submit both the code and description within one week of notification will disqualify that entry and additional qualifying entries will be considered for prizes. Sponsor reserves right not to award prizes to any Team whose results cannot be reproduced.
The winning teams for each benchmark may be offered the opportunity to give a 15-minute oral presentation at a computer vision conference workshop. The workshop will be virtual and will take place on Sunday, October 17th (morning Eastern time). Any winning team that would like to give a workshop presentation must submit a written summary that outlines the presented work (2-4 pages length).
11. WHEN WILL PRIZES BE AWARDED?
The prizes will be awarded within a commercially reasonable time frame. All members of a Team may be required to complete and sign additional documentation, such as non-disclosure agreements, representations and warranties, liability and publicity releases (unless prohibited by applicable law), and tax documents, or other similar documentation in order for the potentially winning team to claim the prize. Sponsor will divide all awards that are payable to Entrant Teams evenly among all Entrant Team members and distribute accordingly. Sponsor will in no way be involved in any dispute with respect to receipt of a prize by any other members of a Team.
Only prizes claimed in accordance to these Rules will be awarded.
12. WINNER LIST
A list of all winners of this Challenge will be posted on AIcrowd Site and may be announced at Sponsor’s discretion via Sponsor’s Twitter, Facebook, Blog, Website, or any other means, or at a Sponsor or Admins sponsored or hosted event.
13. YOUR PERSONAL DATA AND PRIVACY
Sponsor may use the personal data you provide via your participation in this Challenge:
- to contact you in relation to the Challenge;
- to confirm the details of your Entry;
- to administer and execute this Challenge, including sharing it with Sponsor Admins;
- at Sponsor’s discretion, to credit you and/or your Team for the Entry, identify you and/or your Team as a Winner, or other similar notice; and
- as otherwise noted in these Rules or as necessary for Sponsor to meet their obligations under these Rules or applicable law.
By participating in this Challenge, Entrants are authorizing the transfer of personal data to the United States for purposes of administering the Challenge, conducting publicity about the Challenge and such additional purposes consistent with Sponsor’s goals or the Challenge goals. By entering the Challenge, Entrants consent to Sponsor’s and Sponsor Admin’s collection, and Sponsor’s use and disclosure of entrants’ personally identifiable information for these purposes.
Please read the terms and conditions of the AIcrowd Site carefully to understand how your data may be used by AIcrowd SA.
14. ADDITIONAL TERMS AND CONDITIONS
If Sponsor determines, in its sole discretion, that any portion of this Challenge is compromised by virus, bugs, unauthorized human intervention, or any other causes beyond its control, that in the sole opinion of Sponsor corrupts, or impairs the administration, security, fairness or proper participation in/of the Challenge, Sponsor reserves the right to (a) cancel the Challenge; (b) pause the Challenge until such time the aforementioned issues may be resolved; or (c) consider only those Entries submitted prior to the when the Challenge was so compromised for the prizes.
All activities relating to Participant’s participation in the Challenge and material submitted are subject to verification and/or auditing for compliance with these Rules and Participants agree to reasonably cooperate with Sponsor concerning verification and/or auditing. In the event that Challenge verification activity or an audit evidences non-compliance with the Rules or official Challenge communications, as determined in Sponsor’s reasonable discretion, a Participant’s continuing participation in any aspect of the Challenge may be suspended or terminated.
ADDITIONAL PRIZE CONDITIONS.
Prizes are non-transferable except as directed by Sponsor. No prize substitutions allowed. Except where prohibited by law, all federal, state, provincial or other tax liabilities are the responsibility of the prize winners, the Sponsor will not be responsible for any tax deductions which may be necessary and Sponsor reserves the right to withhold taxes as required by law. Prize winners will be responsible for paying all costs and expenses related to the prize that are not specifically mentioned, including, but not limited to, taxes, withholdings, and any other expenses that might reasonably be incurred by the winner in receiving or using the prize. All prizes awarded will be subject to any taxes Sponsor is required by law to withhold as well as applicable sales, use, gross receipts, goods and service, or similar transaction based taxes. IF TAXES ARE APPLICABLE TO THE PRIZE(S), IT IS THE RESPONSIBILITY OF THE WINNER TO PAY TO THE APPROPRIATE AUTHORITIES. PAYMENTS TO CHALLENGE WINNERS ARE SUBJECT TO THE EXPRESS REQUIREMENT THAT THE WINNER SUBMIT TO SPONSOR ALL DOCUMENTATION REQUESTED BY SPONSOR (INCLUDING FORMS W-9 OR W-8BEN AS REQUESTED BY SPONSOR) TO PERMIT COMPLIANCE WITH ALL APPLICABLE STATE, FEDERAL, LOCAL AND FOREIGN (INCLUDING PROVINCIAL) TAX REPORTING AND WITHHOLDING REQUIREMENTS. Prize winners are responsible for ensuring that the tax documentation submitted to Sponsor complies with all applicable tax laws and requirements. If a winner fails to provide the documentation or submits incomplete documentation, the prize may be forfeited and Sponsor may, in its sole discretion, select an alternate winner. Designation as a prize winner is subject to Entrant’s proof of compliance with these Official Rules, maintaining compliance with these Official Rules and approval by the Sponsor. All details of prizes not specified herein shall be determined solely by Sponsor.
Your use of any other products and services required by these Rules, whether required by these Rules or not, are subject to the terms and conditions associated with such products or services, including the AIcrowd site and services.
In the event any clause or provision of these Rules prove unenforceable, void or incomplete, the validity of the other conditions will remain unaffected.
WAIVER, RELEASE AND LIMITATION OF LIABILITY
EACH ENTRANT ACCEPTS THE CONDITIONS STATED IN THESE OFFICIAL RULES, AGREES TO BE BOUND BY THE DECISIONS OF THE SPONSOR, WARRANTS THAT HE OR SHE IS ELIGIBLE TO PARTICIPATE IN THIS CHALLENGE, AND AGREES TO RELEASE, INDEMNIFY, AND HOLD HARMLESS CHALLENGE ENTITIES AND THE PERSONNEL OF EACH FROM AND AGAINST ANY AND ALL CLAIMS, LOSSES, LIABILITY, AND DAMAGES OF ANY KIND (INCLUDING REASONABLE ATTORNEYS’ FEES AND EXPENSES) ASSERTED AGAINST ANY OF THEM, INCURRED OR SUSTAINED IN CONNECTION WITH OR RISING OUT OF ENTRANT’S PARTICIPATION IN THIS CHALLENGE OR ANY TRAVEL OR ACTIVITY RELATED THERETO, OR BREACH OF ANY AGREEMENT OR WARRANTY ASSOCIATED WITH THE CHALLENGE, INCLUDING THESE OFFICIAL RULES. ANY ATTEMPT TO DELIBERATELY DAMAGE ANY WEBSITE OR UNDERMINE THE LEGITIMATE OPERATION OF THE CHALLENGE IS A VIOLATION OF CRIMINAL AND CIVIL LAWS AND, SHOULD SUCH AN ATTEMPT BE MADE, THE CHALLENGE ENTITIES AND EACH OF THEIR LICENSEES RESERVE THE RIGHT TO SEEK ANY AND ALL REMEDIES AVAILABLE FROM ANY SUCH PERSON(S) RESPONSIBLE FOR ANY SUCH ATTEMPT TO THE FULLEST EXTENT PERMITTED BY LAW.
Each Entrant hereby acknowledges and agrees that the relationship between themselves and the Challenge Entities is not a confidential, fiduciary, or other special relationship, and that the Entrant’s decision to provide the entry to Sponsor for purposes of the Challenge does not place the Challenge Entities in a position that is any different from the position held by members of the general public with regard to elements of the entry, other than as set forth in these Official Rules. Each Entrant understands and acknowledges that the Challenge Entities have developed their own airborne object detection and tracking tools, and that new ideas are constantly being developed by their own employees. Each Entrant also acknowledges that many ideas may be competitive with, similar to, or identical to their submission in theme, idea, format, or other respects. Each Entrant acknowledges and agrees that such Entrant will not be entitled to any compensation as a result of Challenge Entities' use of any such similar or identical material that has or may come to Challenge Entities, or any of them, from other sources. Entrants acknowledge that other Entrants/Entrant Teams may have created ideas and concepts that may have familiarities or similarities to their submission, and that they will not be entitled to any compensation or right to negotiate with the Challenge Entities because of these familiarities or similarities.
Entrants further agree that the Challenge Entities are not responsible for the following: (a) electronic transmissions, entries or notifications that are lost, late, stolen, incomplete, damaged, garbled, destroyed, misdirected or not received by Sponsor or their agents for any reason; (b) any problems or technical malfunctions, errors, omissions, interruptions, deletions, defects, delays in operation or transmission, communication failures and/or human error that may occur in the transmission, shipping errors or delays, receipt or processing of entries or related materials; or for destruction of or unauthorized access to, or alteration of, entries or related material; (c) failed or unavailable hardware, network, software or telephone transmissions, damage to Entrants’ or any person’s computer and/or its contents related to or resulting from participation in this Challenge; (d) causes that jeopardize the administration, security, fairness, integrity, or proper conduct of this Challenge; (e) any entries submitted in a manner that is not expressly allowed under these Official Rules (all such entries will be disqualified); or (f) any printing errors in these Official Rules or in any advertisements or correspondence in connection with this Challenge or the tabulation of scores. Sponsor reserves the right, in its sole discretion, to cancel or suspend this Challenge should virus, bugs, fraud, hacking, or other causes corrupt the administration, security, or proper play of the Challenge, or in the event Sponsor does not receive a minimum of two qualified entries from separate eligible Entrant Teams. Sponsor further reserves the right, in its sole discretion, to cancel or suspend this Challenge or to reschedule or reformat events should Sponsor be prevented, in any manner whatsoever, from holding this Challenge or any event due to any present or future law (whether or not valid); any act of God, earthquake, fire, flood, epidemic (including, without limitation, any pandemic), accident, explosion or casualty; any civil disturbance or armed conflict; or any other cause of any similar nature outside of Sponsor’s control. In all such cases, notice to this effect will be posted on the Challenge Site and prizes to the extent awarded will be awarded as determined by Sponsor prior to cancellation. If, in Sponsor’s opinion, there is any suspected or actual evidence of electronic or non-electronic tampering with any portion of the Challenge or if technical difficulties compromise the integrity of the Challenge, the Sponsor reserves the right to void suspect entries and/or terminate the Challenge and award prizes in its sole discretion. Sponsor reserves the right, in its sole discretion, to disqualify any individual found tampering with the entry process or entry materials or otherwise interfering with the proper administration of the Challenge or violating these Official Rules.
DISPUTES: Except where prohibited, you agree that: (1) any and all disputes, claims and causes of action arising out of or connected with this Challenge or any prize awarded shall be resolved individually, without resort to any form of class action; (2) any and all claims, judgments and awards shall be limited to actual out-of-pocket costs incurred, including costs associated with entering this Challenge, but not to exceed $15,000 USD and in no event to include attorneys’ fees; and (3) under no circumstances will you be permitted to obtain awards for, and you hereby waive all rights to claim, indirect, punitive, incidental and consequential damages and any other damages (other than for actual out-of-pocket expenses), and any and all rights to have damages multiplied or otherwise increased. All issues and questions concerning the construction, validity, interpretation and enforceability of these Official Rules, or the rights and obligations of the Entrant and Sponsor in connection with the Challenge, shall be governed by, and construed in accordance with, the laws of the State of Washington without giving effect to any choice of law or conflict of law rules (whether of the State of Washington or any other jurisdiction), which would cause the application of the laws of any jurisdiction other than the State of Washington.