{ "id": 574913, "title": "Submission Re-Enabled (PLEASE READ)", "url": "/competitions/stanford-rna-3d-folding/discussion/574913", "author_name": "inversion", "post_date": "2025-04-24T19:24:01.098000", "votes": 4, "comment_count": 33, "views": 0, "content": "

Hi Everyone -

\n

As per the Competition Phases and Updates, the test dataset has been updated, and submissions re-enabled. (Updates to the training dataset are still TBD.)

\n

The current leaderboard scores have been wiped. For each team, the top two submissions (or selected submissions) are currently being re-run on the new test data. These will populate to the Leaderboard once complete. To be kind to our GPU pools, please refrain from re-submitting any previous submissions, but of course, feel free to submit new work.

", "messages": [ { "id": 3186508, "postDate": "2025-04-24T19:24:01.100Z", "content": "

Hi Everyone -

\n

As per the Competition Phases and Updates, the test dataset has been updated, and submissions re-enabled. (Updates to the training dataset are still TBD.)

\n

The current leaderboard scores have been wiped. For each team, the top two submissions (or selected submissions) are currently being re-run on the new test data. These will populate to the Leaderboard once complete. To be kind to our GPU pools, please refrain from re-submitting any previous submissions, but of course, feel free to submit new work.

", "rawMarkdown": "Hi Everyone - \n\nAs per the [Competition Phases and Updates](https://www.kaggle.com/competitions/stanford-rna-3d-folding/data), the test dataset has been updated, and submissions re-enabled. (Updates to the training dataset are still TBD.) \n\nThe current leaderboard scores have been wiped. For each team, the top two submissions (or selected submissions) are currently being re-run on the new test data. These will populate to the Leaderboard once complete. To be kind to our GPU pools, **please refrain from re-submitting any previous submissions**, but of course, feel free to submit new work.\n\n", "votes": 4 }, { "id": 3187391, "postDate": "2025-04-26T00:19:48.480Z", "content": "

@inversion, something may have gone wrong with my particular re-run. I didn't select any submissions and the automatic selection took my two worst (versions) scores instead of the two best for the re-run. Is this possible?

", "rawMarkdown": "@inversion, something may have gone wrong with my particular re-run. I didn't select any submissions and the automatic selection took my two worst (versions) scores instead of the two best for the re-run. Is this possible?", "votes": 1, "replies": [ { "id": 3187399, "postDate": "2025-04-26T00:48:14.977Z", "content": "

Actually, my best 2 notebooks didn't rerun automatically, untill I rerun them manually.

", "rawMarkdown": "Actually, my best 2 notebooks didn't rerun automatically, untill I rerun them manually.", "votes": 1, "replies": [ { "id": 3187402, "postDate": "2025-04-26T00:55:19.450Z", "content": "

But your 2 automatic rescorings were also on your 2 worst versions if, like in my case, you didn't intentionally select 2 submissions?

", "rawMarkdown": "But your 2 automatic rescorings were also on your 2 worst versions if, like in my case, you didn't intentionally select 2 submissions?" }, { "id": 3187405, "postDate": "2025-04-26T01:18:53.173Z", "content": "

Yes, the automatic selection took my two worst (versions) scores instead of the two best for the re-run.

", "rawMarkdown": "Yes, the automatic selection took my two worst (versions) scores instead of the two best for the re-run. ", "votes": 1 }, { "id": 3187420, "postDate": "2025-04-26T02:11:59.027Z", "content": "

Same..I didn't select best two submissions, and automatic selection has gone wrong.

", "rawMarkdown": "Same..I didn't select best two submissions, and automatic selection has gone wrong.", "votes": 1 }, { "id": 3187506, "postDate": "2025-04-26T06:00:46.177Z", "content": "

Same here, took two worst submissions

", "rawMarkdown": "Same here, took two worst submissions", "votes": 1 }, { "id": 3189039, "postDate": "2025-04-28T16:43:24.987Z", "content": "

Do you see the best two re-run now?

", "rawMarkdown": "Do you see the best two re-run now?", "votes": 1 }, { "id": 3189152, "postDate": "2025-04-28T20:37:02.477Z", "content": "

Ok, thanks a lot!

", "rawMarkdown": "Ok, thanks a lot!" } ] }, { "id": 3187434, "postDate": "2025-04-26T02:59:11.427Z", "content": "

Thanks for highlighting. Investigating . . .

", "rawMarkdown": "Thanks for highlighting. Investigating . . .", "votes": 1 } ] }, { "id": 3187562, "postDate": "2025-04-26T07:49:26.077Z", "content": "

Same problem. My two worst submissions were selected instead of my two best… any problems sorting by score? Should I resubmit manually?

", "rawMarkdown": "Same problem. My two worst submissions were selected instead of my two best... any problems sorting by score? Should I resubmit manually?" }, { "id": 3186982, "postDate": "2025-04-25T11:45:01.567Z", "content": "

I re-ran the notebook and submitted it. I am getting a submission scoring error. Has anyone encountered this issue before? What was the input CSV given?

", "rawMarkdown": "I re-ran the notebook and submitted it. I am getting a submission scoring error. Has anyone encountered this issue before? What was the input CSV given?", "replies": [ { "id": 3187783, "postDate": "2025-04-26T14:38:54.523Z", "content": "

Can you post the error you're getting now? Also, tagging @inversion to help us debug.

", "rawMarkdown": "Can you post the error you're getting now? Also, tagging @inversion to help us debug. ", "replies": [ { "id": 3187793, "postDate": "2025-04-26T14:47:01.667Z", "rawMarkdown": "", "isDeleted": true }, { "id": 3188201, "postDate": "2025-04-27T08:03:55.327Z", "content": "

solved the issue

", "rawMarkdown": "solved the issue" } ] } ] }, { "id": 3186897, "postDate": "2025-04-25T09:26:36.270Z", "content": "

🤨🤨What's happening?

", "rawMarkdown": "🤨🤨What's happening?\n" }, { "id": 3186799, "postDate": "2025-04-25T07:25:54.093Z", "content": "

It seems like no rescoring are happening. Submissions should have status \"Pending\" or something like this, but they are all \"Succeded\" with error marks and old scores.

", "rawMarkdown": "It seems like no rescoring are happening. Submissions should have status \"Pending\" or something like this, but they are all \"Succeded\" with error marks and old scores.", "replies": [ { "id": 3186847, "postDate": "2025-04-25T08:21:43.117Z", "content": "

No rescoring is happening and test sequences havent been updated yet

", "rawMarkdown": "No rescoring is happening and test sequences havent been updated yet", "replies": [ { "id": 3186851, "postDate": "2025-04-25T08:30:49.107Z", "content": "

@arunodhayan test sequences are dummy sequences this time I think? There's no rescore until now, and I just manually submit one🤔.

", "rawMarkdown": "@arunodhayan test sequences are dummy sequences this time I think? There's no rescore until now, and I just manually submit one🤔." }, { "id": 3186861, "postDate": "2025-04-25T08:43:13.723Z", "content": "

So, should we wait or just resubmit again?

", "rawMarkdown": "So, should we wait or just resubmit again?" }, { "id": 3186874, "postDate": "2025-04-25T09:09:49.013Z", "rawMarkdown": "", "isDeleted": true }, { "id": 3186886, "postDate": "2025-04-25T09:18:45.913Z", "content": "

@sweetyheehee ok i will do it

", "rawMarkdown": "@sweetyheehee ok i will do it" }, { "id": 3187016, "postDate": "2025-04-25T12:43:28.573Z", "content": "

@neodrive, how did you resubmit the notebook? I'm getting a submission scoring error. Have all your selected notebooks reran by the organizers

", "rawMarkdown": "@neodrive, how did you resubmit the notebook? I'm getting a submission scoring error. Have all your selected notebooks reran by the organizers" }, { "id": 3187033, "postDate": "2025-04-25T13:16:00.443Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 3186981, "postDate": "2025-04-25T11:41:39.400Z", "content": "

Based on my experience in other competitions, rescoring usually takes time… I'm seeing that on the LB there are only a little over 100 teams at the moment so that suggests rescoring is still in progress… I'd give it a couple of days until the LB is fully updated…

", "rawMarkdown": "Based on my experience in other competitions, rescoring usually takes time... I'm seeing that on the LB there are only a little over 100 teams at the moment so that suggests rescoring is still in progress... I'd give it a couple of days until the LB is fully updated...", "replies": [ { "id": 3187085, "postDate": "2025-04-25T14:34:20.997Z", "content": "

I expect things will finish up in an hour or two. The way re-runs work is they are batched, and all need to complete before they are publisish.

", "rawMarkdown": "I expect things will finish up in an hour or two. The way re-runs work is they are batched, and all need to complete before they are publisish." }, { "id": 3187087, "postDate": "2025-04-25T14:37:43.737Z", "content": "

@inversion same script which has been scored previously, now when I try to rerun and submit I get submission scoring error

", "rawMarkdown": "@inversion same script which has been scored previously, now when I try to rerun and submit I get submission scoring error " } ] } ] }, { "id": 3186757, "postDate": "2025-04-25T06:20:30.653Z", "content": "

@inversion my team join this competition few days ago. We didn't submit our notebook so we didn't have any rank in leaderboard.So, are we eligible to participate?

", "rawMarkdown": "@inversion my team join this competition few days ago. We didn't submit our notebook so we didn't have any rank in leaderboard.So, are we eligible to participate?", "replies": [ { "id": 3187081, "postDate": "2025-04-25T14:33:18.090Z", "content": "

Yes! The competition is still open. The rescores are only for teams that submitted before.

", "rawMarkdown": "Yes! The competition is still open. The rescores are only for teams that submitted before.", "votes": 2 } ] }, { "id": 3186728, "postDate": "2025-04-25T05:17:02.680Z", "content": "

@inversion If i don't submit any submission file previously, am I eligible to participate.

", "rawMarkdown": "@inversion If i don't submit any submission file previously, am I eligible to participate.", "replies": [ { "id": 3187082, "postDate": "2025-04-25T14:33:21.473Z", "content": "

Yes! The competition is still open.

", "rawMarkdown": "Yes! The competition is still open. ", "votes": 1 } ] }, { "id": 3186551, "postDate": "2025-04-24T20:46:44.437Z", "content": "

We got error in our selected notebooks ,is it normal? \"Please unselect your submissions with errors
\nAfter rescoring, your previously selected submissions generated errors and became ineligible.\"

", "rawMarkdown": "We got error in our selected notebooks ,is it normal? \"Please unselect your submissions with errors\nAfter rescoring, your previously selected submissions generated errors and became ineligible.\"", "replies": [ { "id": 3186553, "postDate": "2025-04-24T20:53:45.080Z", "content": "

Any selected submissions will be corrected after the re-run. So, no action needed.

", "rawMarkdown": "Any selected submissions will be corrected after the re-run. So, no action needed.", "replies": [ { "id": 3186554, "postDate": "2025-04-24T20:54:42.527Z", "content": "

Okay, Thanks

", "rawMarkdown": "Okay, Thanks " } ] } ] } ], "comments": [ { "id": 3187391, "author_name": "Manuel Campos", "author_url": "", "post_date": "2025-04-26T00:19:48.480000", "content": "

@inversion, something may have gone wrong with my particular re-run. I didn't select any submissions and the automatic selection took my two worst (versions) scores instead of the two best for the re-run. Is this possible?

", "votes": 1, "replies": [ { "id": 3187399, "author_name": "Aleksandr Larko", "author_url": "", "post_date": "2025-04-26T00:48:14.977000", "content": "

Actually, my best 2 notebooks didn't rerun automatically, untill I rerun them manually.

", "votes": 1, "replies": [ { "id": 3187402, "author_name": "Manuel Campos", "author_url": "", "post_date": "2025-04-26T00:55:19.450000", "content": "

But your 2 automatic rescorings were also on your 2 worst versions if, like in my case, you didn't intentionally select 2 submissions?

", "votes": 0, "replies": [] }, { "id": 3187405, "author_name": "Aleksandr Larko", "author_url": "", "post_date": "2025-04-26T01:18:53.173000", "content": "

Yes, the automatic selection took my two worst (versions) scores instead of the two best for the re-run.

", "votes": 1, "replies": [] }, { "id": 3187420, "author_name": "doheon114", "author_url": "", "post_date": "2025-04-26T02:11:59.027000", "content": "

Same..I didn't select best two submissions, and automatic selection has gone wrong.

", "votes": 1, "replies": [] }, { "id": 3187506, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-26T06:00:46.177000", "content": "

Same here, took two worst submissions

", "votes": 1, "replies": [] }, { "id": 3189039, "author_name": "inversion", "author_url": "", "post_date": "2025-04-28T16:43:24.987000", "content": "

Do you see the best two re-run now?

", "votes": 1, "replies": [] }, { "id": 3189152, "author_name": "Manuel Campos", "author_url": "", "post_date": "2025-04-28T20:37:02.477000", "content": "

Ok, thanks a lot!

", "votes": 0, "replies": [] } ] }, { "id": 3187434, "author_name": "inversion", "author_url": "", "post_date": "2025-04-26T02:59:11.427000", "content": "

Thanks for highlighting. Investigating . . .

", "votes": 1, "replies": [] } ] }, { "id": 3187562, "author_name": "Rem1210", "author_url": "", "post_date": "2025-04-26T07:49:26.077000", "content": "

Same problem. My two worst submissions were selected instead of my two best… any problems sorting by score? Should I resubmit manually?

", "votes": 0, "replies": [] }, { "id": 3186982, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-25T11:45:01.567000", "content": "

I re-ran the notebook and submitted it. I am getting a submission scoring error. Has anyone encountered this issue before? What was the input CSV given?

", "votes": 0, "replies": [ { "id": 3187783, "author_name": "Rhiju Das", "author_url": "", "post_date": "2025-04-26T14:38:54.523000", "content": "

Can you post the error you're getting now? Also, tagging @inversion to help us debug.

", "votes": 0, "replies": [ { "id": 3187793, "author_name": "", "author_url": "", "post_date": "2025-04-26T14:47:01.667000", "content": "", "votes": 0, "replies": [] }, { "id": 3188201, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-27T08:03:55.327000", "content": "

solved the issue

", "votes": 0, "replies": [] } ] } ] }, { "id": 3186897, "author_name": "AI_nerd_", "author_url": "", "post_date": "2025-04-25T09:26:36.270000", "content": "

🤨🤨What's happening?

", "votes": 0, "replies": [] }, { "id": 3186799, "author_name": "Ogurtsov", "author_url": "", "post_date": "2025-04-25T07:25:54.093000", "content": "

It seems like no rescoring are happening. Submissions should have status \"Pending\" or something like this, but they are all \"Succeded\" with error marks and old scores.

", "votes": 0, "replies": [ { "id": 3186847, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-25T08:21:43.117000", "content": "

No rescoring is happening and test sequences havent been updated yet

", "votes": 0, "replies": [ { "id": 3186851, "author_name": "Timmy Juicehouse", "author_url": "", "post_date": "2025-04-25T08:30:49.107000", "content": "

@arunodhayan test sequences are dummy sequences this time I think? There's no rescore until now, and I just manually submit one🤔.

", "votes": 0, "replies": [] }, { "id": 3186861, "author_name": "Ish", "author_url": "", "post_date": "2025-04-25T08:43:13.723000", "content": "

So, should we wait or just resubmit again?

", "votes": 0, "replies": [] }, { "id": 3186874, "author_name": "", "author_url": "", "post_date": "2025-04-25T09:09:49.013000", "content": "", "votes": 0, "replies": [] }, { "id": 3186886, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-25T09:18:45.913000", "content": "

@sweetyheehee ok i will do it

", "votes": 0, "replies": [] }, { "id": 3187016, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-25T12:43:28.573000", "content": "

@neodrive, how did you resubmit the notebook? I'm getting a submission scoring error. Have all your selected notebooks reran by the organizers

", "votes": 0, "replies": [] }, { "id": 3187033, "author_name": "", "author_url": "", "post_date": "2025-04-25T13:16:00.443000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 3186981, "author_name": "JP", "author_url": "", "post_date": "2025-04-25T11:41:39.400000", "content": "

Based on my experience in other competitions, rescoring usually takes time… I'm seeing that on the LB there are only a little over 100 teams at the moment so that suggests rescoring is still in progress… I'd give it a couple of days until the LB is fully updated…

", "votes": 0, "replies": [ { "id": 3187085, "author_name": "inversion", "author_url": "", "post_date": "2025-04-25T14:34:20.997000", "content": "

I expect things will finish up in an hour or two. The way re-runs work is they are batched, and all need to complete before they are publisish.

", "votes": 0, "replies": [] }, { "id": 3187087, "author_name": "Arunodhayan", "author_url": "", "post_date": "2025-04-25T14:37:43.737000", "content": "

@inversion same script which has been scored previously, now when I try to rerun and submit I get submission scoring error

", "votes": 0, "replies": [] } ] } ] }, { "id": 3186757, "author_name": "Swandip Singha", "author_url": "", "post_date": "2025-04-25T06:20:30.653000", "content": "

@inversion my team join this competition few days ago. We didn't submit our notebook so we didn't have any rank in leaderboard.So, are we eligible to participate?

", "votes": 0, "replies": [ { "id": 3187081, "author_name": "inversion", "author_url": "", "post_date": "2025-04-25T14:33:18.090000", "content": "

Yes! The competition is still open. The rescores are only for teams that submitted before.

", "votes": 2, "replies": [] } ] }, { "id": 3186728, "author_name": "Solo_Rider", "author_url": "", "post_date": "2025-04-25T05:17:02.680000", "content": "

@inversion If i don't submit any submission file previously, am I eligible to participate.

", "votes": 0, "replies": [ { "id": 3187082, "author_name": "inversion", "author_url": "", "post_date": "2025-04-25T14:33:21.473000", "content": "

Yes! The competition is still open.

", "votes": 1, "replies": [] } ] }, { "id": 3186551, "author_name": "Adam Logman", "author_url": "", "post_date": "2025-04-24T20:46:44.437000", "content": "

We got error in our selected notebooks ,is it normal? \"Please unselect your submissions with errors
\nAfter rescoring, your previously selected submissions generated errors and became ineligible.\"

", "votes": 0, "replies": [ { "id": 3186553, "author_name": "inversion", "author_url": "", "post_date": "2025-04-24T20:53:45.080000", "content": "

Any selected submissions will be corrected after the re-run. So, no action needed.

", "votes": 0, "replies": [ { "id": 3186554, "author_name": "Adam Logman", "author_url": "", "post_date": "2025-04-24T20:54:42.527000", "content": "

Okay, Thanks

", "votes": 0, "replies": [] } ] } ] } ], "raw_markdown_by_id": { "3186508": "Hi Everyone - \n\nAs per the [Competition Phases and Updates](https://www.kaggle.com/competitions/stanford-rna-3d-folding/data), the test dataset has been updated, and submissions re-enabled. (Updates to the training dataset are still TBD.) \n\nThe current leaderboard scores have been wiped. For each team, the top two submissions (or selected submissions) are currently being re-run on the new test data. These will populate to the Leaderboard once complete. To be kind to our GPU pools, **please refrain from re-submitting any previous submissions**, but of course, feel free to submit new work.\n\n", "3187391": "@inversion, something may have gone wrong with my particular re-run. I didn't select any submissions and the automatic selection took my two worst (versions) scores instead of the two best for the re-run. Is this possible?", "3187562": "Same problem. My two worst submissions were selected instead of my two best... any problems sorting by score? Should I resubmit manually?", "3186982": "I re-ran the notebook and submitted it. I am getting a submission scoring error. Has anyone encountered this issue before? What was the input CSV given?", "3186897": "🤨🤨What's happening?\n", "3186799": "It seems like no rescoring are happening. Submissions should have status \"Pending\" or something like this, but they are all \"Succeded\" with error marks and old scores.", "3186757": "@inversion my team join this competition few days ago. We didn't submit our notebook so we didn't have any rank in leaderboard.So, are we eligible to participate?", "3186728": "@inversion If i don't submit any submission file previously, am I eligible to participate.", "3186551": "We got error in our selected notebooks ,is it normal? \"Please unselect your submissions with errors\nAfter rescoring, your previously selected submissions generated errors and became ineligible.\"" } }