{ "id": 242403, "title": "One Day Deadline Extension", "url": "/competitions/bms-molecular-translation/discussion/242403", "author_name": "", "post_date": "2021-05-28T18:14:21.078124100Z", "votes": 8, "comment_count": 21, "views": 0, "content": "

Hi all,

\n

As you may have seen, we experienced a submission outage yesterday that errored all submissions. Because of how close this is to the competition deadline and the impact it has on final scores, we will be extending the final submission deadline by one day.

\n

The outage was related to a code merge that took effect yesterday evening. We obviously didn't expect any issues and as we saw reports from the community we spent time investigating to determine if it was widespread or acute and how to resolve. Messages were posted in the Kaggle General Forum, but not in each individual competition. Kaggle also has a company-wide holiday today (Friday), hence delayed communication from our team.

\n

We've talked through a number of options to try and make users in impacted competitions whole and concluded that a submission extension of one additional day is the best available option. We've considered all options, including each of those proposed within our various forums, and believe this is the best option both given the impact to competitors and what our platform is capable of within each competition format. The competition timeline page will be updated accordingly.

\n

We understand this is frustrating, and we will work on improving emergency messaging so that you don’t have to dig to find out something is broken.

\n

Again, apologies and thanks for your patience!

", "messages": [ { "id": "1326927", "postDate": "05/28/2021 18:14:21", "content": "

Hi all,

\n

As you may have seen, we experienced a submission outage yesterday that errored all submissions. Because of how close this is to the competition deadline and the impact it has on final scores, we will be extending the final submission deadline by one day.

\n

The outage was related to a code merge that took effect yesterday evening. We obviously didn't expect any issues and as we saw reports from the community we spent time investigating to determine if it was widespread or acute and how to resolve. Messages were posted in the Kaggle General Forum, but not in each individual competition. Kaggle also has a company-wide holiday today (Friday), hence delayed communication from our team.

\n

We've talked through a number of options to try and make users in impacted competitions whole and concluded that a submission extension of one additional day is the best available option. We've considered all options, including each of those proposed within our various forums, and believe this is the best option both given the impact to competitors and what our platform is capable of within each competition format. The competition timeline page will be updated accordingly.

\n

We understand this is frustrating, and we will work on improving emergency messaging so that you don’t have to dig to find out something is broken.

\n

Again, apologies and thanks for your patience!

", "rawMarkdown": "Hi all,\n\nAs you may have seen, we experienced a submission outage yesterday that errored all submissions. Because of how close this is to the competition deadline and the impact it has on final scores, **we will be extending the final submission deadline by one day**.\n\nThe outage was related to a code merge that took effect yesterday evening. We obviously didn't expect any issues and as we saw reports from the community we spent time investigating to determine if it was widespread or acute and how to resolve. Messages were posted in the Kaggle General Forum, but not in each individual competition. Kaggle also has a company-wide holiday today (Friday), hence delayed communication from our team.\n\nWe've talked through a number of options to try and make users in impacted competitions whole and concluded that a submission extension of one additional day is the best available option. We've considered all options, including each of those proposed within our various forums, and believe this is the best option both given the impact to competitors and what our platform is capable of within each competition format. The competition timeline page will be updated accordingly.\n\nWe understand this is frustrating, and we will work on improving emergency messaging so that you don’t have to dig to find out something is broken.\n\nAgain, apologies and thanks for your patience!", "votes": null }, { "id": "1327079", "postDate": "05/28/2021 21:48:41", "content": "

Thanks, we would be being tired one more day!

", "rawMarkdown": "Thanks, we would be being tired one more day!", "votes": null }, { "id": "1327771", "postDate": "05/29/2021 15:58:41", "content": "

Hahaha totally agree, as long as this competition is still alive, I have to work to hold my precarious position.

", "rawMarkdown": "Hahaha totally agree, as long as this competition is still alive, I have to work to hold my precarious position.", "votes": null }, { "id": "1331269", "postDate": "06/01/2021 11:25:34", "content": "

I doubt that extending the deadline is the best/fair solution. Let's see how big an impact this extra day will make on LB.

", "rawMarkdown": "I doubt that extending the deadline is the best/fair solution. Let's see how big an impact this extra day will make on LB.", "votes": null }, { "id": "1331276", "postDate": "06/01/2021 11:30:59", "content": "

It is unfair since everyday we can submit the result.

", "rawMarkdown": "It is unfair since everyday we can submit the result.", "votes": null }, { "id": "1331298", "postDate": "06/01/2021 11:36:40", "content": "

I've never thought that I would be happy for that..

", "rawMarkdown": "I've never thought that I would be happy for that..", "votes": null }, { "id": "1331308", "postDate": "06/01/2021 11:42:29", "content": "

Although I also think that it's unfair. (maybe for my benefit)

", "rawMarkdown": "Although I also think that it's unfair. (maybe for my benefit)", "votes": null }, { "id": "1331315", "postDate": "06/01/2021 11:48:39", "content": "

I think that the moment people weren't able to submit, things became \"unfair\". For instance, I made two submissions that were to determine my next steps. If I had seen the results on the spot I could have started my next training run without having to wait another 12-24 hrs. So the unfairness of this solution should be judged relative to the unfairness of no solution at all. I think it's not bad. And if I get overtaken on the last day, then the better person beat me.

", "rawMarkdown": "I think that the moment people weren't able to submit, things became \"unfair\". For instance, I made two submissions that were to determine my next steps. If I had seen the results on the spot I could have started my next training run without having to wait another 12-24 hrs. So the unfairness of this solution should be judged relative to the unfairness of no solution at all. I think it's not bad. And if I get overtaken on the last day, then the better person beat me.", "votes": null }, { "id": "1331320", "postDate": "06/01/2021 11:52:24", "content": "

You'll never know though, because submissions which may have arrived on Thursday will arrive on Friday instead just because they can.

", "rawMarkdown": "You'll never know though, because submissions which may have arrived on Thursday will arrive on Friday instead just because they can.", "votes": null }, { "id": "1331337", "postDate": "06/01/2021 12:03:09", "content": "

Yes, you are right. People that are hiding their best shot may submit at the last day independent from the extension. However, we don't have to wait for the last day, the LB is already very unstable and this extension will be effective.

", "rawMarkdown": "Yes, you are right. People that are hiding their best shot may submit at the last day independent from the extension. However, we don't have to wait for the last day, the LB is already very unstable and this extension will be effective.", "votes": null }, { "id": "1331355", "postDate": "06/01/2021 12:18:51", "content": "

I've never thought that I would be happy for that..
\nI am also quite happy, as I started far to late with the full training and can now rectify my mistakes at least a little bit. (Although the reproduction of research papers and toying around was fun and I learned a lot)
\nSo maybe, just maybe, I will place significantly higher than otherwise. Maybe even barely bronze. But yes, I guess that is unfair towards others who submitted far earlier.
\nBut please hosts & Kaggle staff, keep the extension…

", "rawMarkdown": "`I've never thought that I would be happy for that..`\nI am also quite happy, as I started far to late with the full training and can now rectify my mistakes at least a little bit. (Although the reproduction of research papers and toying around was fun and I learned a lot)\nSo maybe, just maybe, I will place significantly higher than otherwise. Maybe even barely bronze. But yes, I guess that is unfair towards others who submitted far earlier. \nBut please hosts & Kaggle staff, keep the extension...", "votes": null }, { "id": "1331361", "postDate": "06/01/2021 12:23:03", "content": "

@alexandersoare I don't agree. First, this solution does not serve the people who exposed to the problem, but everyone benefits from the extension. Since everyone benefits from the extension, it may also look harmless. But when you think in an extreme example: \"If it is harmless, let's extend 30 more days!\", it is easier to see the effect. Especially for unstable LB's.

", "rawMarkdown": "alexandersoare I don't agree. First, this solution does not serve the people who exposed to the problem, but everyone benefits from the extension. Since everyone benefits from the extension, it may also look harmless. But when you think in an extreme example: \"If it is harmless, let's extend 30 more days!\", it is easier to see the effect. Especially for unstable LB's.", "votes": null }, { "id": "1331365", "postDate": "06/01/2021 12:25:45", "content": "

If submissions were blocked for 30 days I think an extension of that order of magnitude wouldn't be worse than none at all no? Anyway, curious to know what you would propose instead.

", "rawMarkdown": "If submissions were blocked for 30 days I think an extension of that order of magnitude wouldn't be worse than none at all no? Anyway, curious to know what you would propose instead.", "votes": null }, { "id": "1331403", "postDate": "06/01/2021 12:52:20", "content": "

No, it would worse. Because we are improving our models by training not by submitting. Of course, you can get feedback from LB by submitting, however since we have 2.4 million train instances the CV and LB is pretty correlated (many high LB's very rarely used it). Therefore time is more valuable than submissions.

\n

Besides your example is not exactly match with the case since the submissions were blocked only a few hours not all day.

", "rawMarkdown": "No, it would worse. Because we are improving our models by training not by submitting. Of course, you can get feedback from LB by submitting, however since we have 2.4 million train instances the CV and LB is pretty correlated (many high LB's very rarely used it). Therefore time is more valuable than submissions. \n\nBesides your example is not exactly match with the case since the submissions were blocked only a few hours not all day.", "votes": null }, { "id": "1331422", "postDate": "06/01/2021 13:09:30", "content": "

Fair point. Well, best of luck @sorkun !

", "rawMarkdown": "Fair point. Well, best of luck @sorkun !", "votes": null }, { "id": "1332104", "postDate": "06/01/2021 22:56:12", "content": "

@alexandersoare thanks for the discussion, good luck!

", "rawMarkdown": "alexandersoare thanks for the discussion, good luck!", "votes": null }, { "id": "1333209", "postDate": "06/02/2021 14:54:06", "content": "

It is unfair that we don't have enough GPU/TPU. lol

", "rawMarkdown": "It is unfair that we don't have enough GPU/TPU. lol", "votes": null }, { "id": "1333835", "postDate": "06/03/2021 05:02:39", "content": "

Thank you! One question: should I just choose two checkboxes for already downloaded submissions to make a final submissions or I need to submit final submissions separately by pressing additional buttons?

", "rawMarkdown": "Thank you! One question: should I just choose two checkboxes for already downloaded submissions to make a final submissions or I need to submit final submissions separately by pressing additional buttons?", "votes": null }, { "id": "1333851", "postDate": "06/03/2021 05:16:26", "content": "

You mean \"choose two checkboxes for already uploaded submissions\" ?
\nYes, if you go to My Submissions, there you have to choose those (maximum of 2) that you want to be your final submissions. You just need to check them, no additional presses are required.

", "rawMarkdown": "You mean \"choose two checkboxes for already **uploaded** submissions\" ?\nYes, if you go to My Submissions, there you have to choose those (maximum of 2) that you want to be your final submissions. You just need to check them, no additional presses are required.", "votes": null }, { "id": "1334082", "postDate": "06/03/2021 09:19:58", "content": "

that's great

", "rawMarkdown": "that's great", "votes": null }, { "id": "1335051", "postDate": "06/04/2021 01:45:44", "content": "

why I can't see my team on the leaderboard? We should be 34th, my score is 1.03.

", "rawMarkdown": "why I can't see my team on the leaderboard? We should be 34th, my score is 1.03.", "votes": null }, { "id": "1335054", "postDate": "06/04/2021 01:48:11", "content": "

Sorry to bother you ，Do you know the contact information of the organizer？Our team submitted 1.34 to be 34, and then suddenly we can’t see our ranking.

", "rawMarkdown": "Sorry to bother you ，Do you know the contact information of the organizer？Our team submitted 1.34 to be 34, and then suddenly we can’t see our ranking.", "votes": null } ], "comments": [ { "id": 1327079, "author_name": "bamps53", "author_url": "", "post_date": "05/28/2021 21:48:41", "content": "

Thanks, we would be being tired one more day!

", "votes": null, "replies": [ { "id": 1327771, "author_name": "alexandersoare", "author_url": "", "post_date": "05/29/2021 15:58:41", "content": "

Hahaha totally agree, as long as this competition is still alive, I have to work to hold my precarious position.

", "votes": null, "replies": [] }, { "id": 1331298, "author_name": "nofreewill", "author_url": "", "post_date": "06/01/2021 11:36:40", "content": "

I've never thought that I would be happy for that..

", "votes": null, "replies": [] }, { "id": 1331308, "author_name": "nofreewill", "author_url": "", "post_date": "06/01/2021 11:42:29", "content": "

Although I also think that it's unfair. (maybe for my benefit)

", "votes": null, "replies": [] }, { "id": 1331315, "author_name": "alexandersoare", "author_url": "", "post_date": "06/01/2021 11:48:39", "content": "

I think that the moment people weren't able to submit, things became \"unfair\". For instance, I made two submissions that were to determine my next steps. If I had seen the results on the spot I could have started my next training run without having to wait another 12-24 hrs. So the unfairness of this solution should be judged relative to the unfairness of no solution at all. I think it's not bad. And if I get overtaken on the last day, then the better person beat me.

", "votes": null, "replies": [] }, { "id": 1331355, "author_name": "cepheidq", "author_url": "", "post_date": "06/01/2021 12:18:51", "content": "

I've never thought that I would be happy for that..
\nI am also quite happy, as I started far to late with the full training and can now rectify my mistakes at least a little bit. (Although the reproduction of research papers and toying around was fun and I learned a lot)
\nSo maybe, just maybe, I will place significantly higher than otherwise. Maybe even barely bronze. But yes, I guess that is unfair towards others who submitted far earlier.
\nBut please hosts & Kaggle staff, keep the extension…

", "votes": null, "replies": [] }, { "id": 1331361, "author_name": "sorkun", "author_url": "", "post_date": "06/01/2021 12:23:03", "content": "

@alexandersoare I don't agree. First, this solution does not serve the people who exposed to the problem, but everyone benefits from the extension. Since everyone benefits from the extension, it may also look harmless. But when you think in an extreme example: \"If it is harmless, let's extend 30 more days!\", it is easier to see the effect. Especially for unstable LB's.

", "votes": null, "replies": [] }, { "id": 1331365, "author_name": "alexandersoare", "author_url": "", "post_date": "06/01/2021 12:25:45", "content": "

If submissions were blocked for 30 days I think an extension of that order of magnitude wouldn't be worse than none at all no? Anyway, curious to know what you would propose instead.

", "votes": null, "replies": [] }, { "id": 1331403, "author_name": "sorkun", "author_url": "", "post_date": "06/01/2021 12:52:20", "content": "

No, it would worse. Because we are improving our models by training not by submitting. Of course, you can get feedback from LB by submitting, however since we have 2.4 million train instances the CV and LB is pretty correlated (many high LB's very rarely used it). Therefore time is more valuable than submissions.

\n

Besides your example is not exactly match with the case since the submissions were blocked only a few hours not all day.

", "votes": null, "replies": [] }, { "id": 1331422, "author_name": "alexandersoare", "author_url": "", "post_date": "06/01/2021 13:09:30", "content": "

Fair point. Well, best of luck @sorkun !

", "votes": null, "replies": [] }, { "id": 1332104, "author_name": "sorkun", "author_url": "", "post_date": "06/01/2021 22:56:12", "content": "

@alexandersoare thanks for the discussion, good luck!

", "votes": null, "replies": [] } ] }, { "id": 1331269, "author_name": "sorkun", "author_url": "", "post_date": "06/01/2021 11:25:34", "content": "

I doubt that extending the deadline is the best/fair solution. Let's see how big an impact this extra day will make on LB.

", "votes": null, "replies": [ { "id": 1331320, "author_name": "alexandersoare", "author_url": "", "post_date": "06/01/2021 11:52:24", "content": "

You'll never know though, because submissions which may have arrived on Thursday will arrive on Friday instead just because they can.

", "votes": null, "replies": [] }, { "id": 1331337, "author_name": "sorkun", "author_url": "", "post_date": "06/01/2021 12:03:09", "content": "

Yes, you are right. People that are hiding their best shot may submit at the last day independent from the extension. However, we don't have to wait for the last day, the LB is already very unstable and this extension will be effective.

", "votes": null, "replies": [] } ] }, { "id": 1331276, "author_name": "zhongfeisheng6666", "author_url": "", "post_date": "06/01/2021 11:30:59", "content": "

It is unfair since everyday we can submit the result.

", "votes": null, "replies": [ { "id": 1333209, "author_name": "dragonzhang", "author_url": "", "post_date": "06/02/2021 14:54:06", "content": "

It is unfair that we don't have enough GPU/TPU. lol

", "votes": null, "replies": [] }, { "id": 1335054, "author_name": "barryallen01", "author_url": "", "post_date": "06/04/2021 01:48:11", "content": "

Sorry to bother you ，Do you know the contact information of the organizer？Our team submitted 1.34 to be 34, and then suddenly we can’t see our ranking.

", "votes": null, "replies": [] } ] }, { "id": 1333835, "author_name": "kseniapolonskaya", "author_url": "", "post_date": "06/03/2021 05:02:39", "content": "

Thank you! One question: should I just choose two checkboxes for already downloaded submissions to make a final submissions or I need to submit final submissions separately by pressing additional buttons?

", "votes": null, "replies": [ { "id": 1333851, "author_name": "nofreewill", "author_url": "", "post_date": "06/03/2021 05:16:26", "content": "

You mean \"choose two checkboxes for already uploaded submissions\" ?
\nYes, if you go to My Submissions, there you have to choose those (maximum of 2) that you want to be your final submissions. You just need to check them, no additional presses are required.

", "votes": null, "replies": [] } ] }, { "id": 1334082, "author_name": "venumadhavs", "author_url": "", "post_date": "06/03/2021 09:19:58", "content": "

that's great

", "votes": null, "replies": [] }, { "id": 1335051, "author_name": "barryallen01", "author_url": "", "post_date": "06/04/2021 01:45:44", "content": "

why I can't see my team on the leaderboard? We should be 34th, my score is 1.03.

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "1326927": "Hi all,\n\nAs you may have seen, we experienced a submission outage yesterday that errored all submissions. Because of how close this is to the competition deadline and the impact it has on final scores, **we will be extending the final submission deadline by one day**.\n\nThe outage was related to a code merge that took effect yesterday evening. We obviously didn't expect any issues and as we saw reports from the community we spent time investigating to determine if it was widespread or acute and how to resolve. Messages were posted in the Kaggle General Forum, but not in each individual competition. Kaggle also has a company-wide holiday today (Friday), hence delayed communication from our team.\n\nWe've talked through a number of options to try and make users in impacted competitions whole and concluded that a submission extension of one additional day is the best available option. We've considered all options, including each of those proposed within our various forums, and believe this is the best option both given the impact to competitors and what our platform is capable of within each competition format. The competition timeline page will be updated accordingly.\n\nWe understand this is frustrating, and we will work on improving emergency messaging so that you don’t have to dig to find out something is broken.\n\nAgain, apologies and thanks for your patience!", "1327079": "Thanks, we would be being tired one more day!", "1327771": "Hahaha totally agree, as long as this competition is still alive, I have to work to hold my precarious position.", "1331269": "I doubt that extending the deadline is the best/fair solution. Let's see how big an impact this extra day will make on LB.", "1331276": "It is unfair since everyday we can submit the result.", "1331298": "I've never thought that I would be happy for that..", "1331308": "Although I also think that it's unfair. (maybe for my benefit)", "1331315": "I think that the moment people weren't able to submit, things became \"unfair\". For instance, I made two submissions that were to determine my next steps. If I had seen the results on the spot I could have started my next training run without having to wait another 12-24 hrs. So the unfairness of this solution should be judged relative to the unfairness of no solution at all. I think it's not bad. And if I get overtaken on the last day, then the better person beat me.", "1331320": "You'll never know though, because submissions which may have arrived on Thursday will arrive on Friday instead just because they can.", "1331337": "Yes, you are right. People that are hiding their best shot may submit at the last day independent from the extension. However, we don't have to wait for the last day, the LB is already very unstable and this extension will be effective.", "1331355": "`I've never thought that I would be happy for that..`\nI am also quite happy, as I started far to late with the full training and can now rectify my mistakes at least a little bit. (Although the reproduction of research papers and toying around was fun and I learned a lot)\nSo maybe, just maybe, I will place significantly higher than otherwise. Maybe even barely bronze. But yes, I guess that is unfair towards others who submitted far earlier. \nBut please hosts & Kaggle staff, keep the extension...", "1331361": "alexandersoare I don't agree. First, this solution does not serve the people who exposed to the problem, but everyone benefits from the extension. Since everyone benefits from the extension, it may also look harmless. But when you think in an extreme example: \"If it is harmless, let's extend 30 more days!\", it is easier to see the effect. Especially for unstable LB's.", "1331365": "If submissions were blocked for 30 days I think an extension of that order of magnitude wouldn't be worse than none at all no? Anyway, curious to know what you would propose instead.", "1331403": "No, it would worse. Because we are improving our models by training not by submitting. Of course, you can get feedback from LB by submitting, however since we have 2.4 million train instances the CV and LB is pretty correlated (many high LB's very rarely used it). Therefore time is more valuable than submissions. \n\nBesides your example is not exactly match with the case since the submissions were blocked only a few hours not all day.", "1331422": "Fair point. Well, best of luck @sorkun !", "1332104": "alexandersoare thanks for the discussion, good luck!", "1333209": "It is unfair that we don't have enough GPU/TPU. lol", "1333835": "Thank you! One question: should I just choose two checkboxes for already downloaded submissions to make a final submissions or I need to submit final submissions separately by pressing additional buttons?", "1333851": "You mean \"choose two checkboxes for already **uploaded** submissions\" ?\nYes, if you go to My Submissions, there you have to choose those (maximum of 2) that you want to be your final submissions. You just need to check them, no additional presses are required.", "1334082": "that's great", "1335051": "why I can't see my team on the leaderboard? We should be 34th, my score is 1.03.", "1335054": "Sorry to bother you ，Do you know the contact information of the organizer？Our team submitted 1.34 to be 34, and then suddenly we can’t see our ranking." }, "source": "meta" }