There is a major event coming up in the competition on Wednesday, April 23, 2025.
\nOn that date, we will be refreshing the leaderboard to remove any RNA targets that have been leaked in the public databases, and adding some new targets.
\nThe new RNA targets have 3D structures that have been experimentally determined by competition hosts and collaborators. The VFOLD human expert team is also providing baseline predictions.
\nIn addition to stress testing your notebooks, this data refresh will allow us to decide on the winners of the Early Sharing Prizes!
\nFrom April 23 onwards, any new submissions will be scored against the new set of targets.
\nIn addition, we will be re-running each team's prior top 2 notebooks. If a team has not selected 2 notebooks, we will use the top 2 as ranked on public leaderboard score before the refresh.
\nAfter all the rescoring, we will see if there are any immediate winners of the Early Sharing Prize. As a reminder, the eligibility conditions from the competition overview page are reposted below.
\nIf you’d like to ensure that your notebooks are under consideration for the Early Sharing Prize, please make them public and with a title that begins with the words “Early Sharing Prize”.
\nAny notebooks that score above VFOLD_human_expert after the data refresh will be evaluated, with precedence given to the first two by publication date that satisfy the eligibility conditions.
Good luck!
\nFor the hosts,
\nRhiju
From the overview page:
\n\n\nTo be eligible for the Early Sharing Prize, you will need to:
\n1) Publish a public notebook scoring above the benchmark score on the leaderboard after the data refresh (first two notebooks that meet this criteria will be evaluated).
\n2) Out of all participants or Teams who have submitted notebooks scoring above the benchmark score, be the first two to make your notebooks public. The public notebook needs to adhere to the same requirements and restrictions regarding licensing, reproducibility, and documentation to which the winning Submission is subject (see Competition Rules).
\n3) Keep the notebooks and any datasets they use publicly available until the Final Submission Deadline of May 29, 2025*. Submissions should only make use of information publicly available before the temporal_cutoff dates provided with test sequences.
\nThe Competition Sponsor will, after the data refresh, assess all Submissions that are eligible for the Early Sharing Prize in the order in which Submissions were made. If it is discovered that such a Submissions that scored more than the benchmark score has no or incomplete documentation, incompatible licensing, or is in any other way incompatible with the rules to which the winning Submission is subject, it will not be considered towards the Early Sharing Prize and the next Submissions will be assessed.
\n
There is a major event coming up in the competition on Wednesday, April 23, 2025.
\nOn that date, we will be refreshing the leaderboard to remove any RNA targets that have been leaked in the public databases, and adding some new targets.
\nThe new RNA targets have 3D structures that have been experimentally determined by competition hosts and collaborators. The VFOLD human expert team is also providing baseline predictions.
\nIn addition to stress testing your notebooks, this data refresh will allow us to decide on the winners of the Early Sharing Prizes!
\nFrom April 23 onwards, any new submissions will be scored against the new set of targets.
\nIn addition, we will be re-running each team's prior top 2 notebooks. If a team has not selected 2 notebooks, we will use the top 2 as ranked on public leaderboard score before the refresh.
\nAfter all the rescoring, we will see if there are any immediate winners of the Early Sharing Prize. As a reminder, the eligibility conditions from the competition overview page are reposted below.
\nIf you’d like to ensure that your notebooks are under consideration for the Early Sharing Prize, please make them public and with a title that begins with the words “Early Sharing Prize”.
\nAny notebooks that score above VFOLD_human_expert after the data refresh will be evaluated, with precedence given to the first two by publication date that satisfy the eligibility conditions.
Good luck!
\nFor the hosts,
\nRhiju
From the overview page:
\n\n\nTo be eligible for the Early Sharing Prize, you will need to:
\n1) Publish a public notebook scoring above the benchmark score on the leaderboard after the data refresh (first two notebooks that meet this criteria will be evaluated).
\n2) Out of all participants or Teams who have submitted notebooks scoring above the benchmark score, be the first two to make your notebooks public. The public notebook needs to adhere to the same requirements and restrictions regarding licensing, reproducibility, and documentation to which the winning Submission is subject (see Competition Rules).
\n3) Keep the notebooks and any datasets they use publicly available until the Final Submission Deadline of May 29, 2025*. Submissions should only make use of information publicly available before the temporal_cutoff dates provided with test sequences.
\nThe Competition Sponsor will, after the data refresh, assess all Submissions that are eligible for the Early Sharing Prize in the order in which Submissions were made. If it is discovered that such a Submissions that scored more than the benchmark score has no or incomplete documentation, incompatible licensing, or is in any other way incompatible with the rules to which the winning Submission is subject, it will not be considered towards the Early Sharing Prize and the next Submissions will be assessed.
\n