My submission failed even though I didn't made any change in the yesterday's successful inference code apart from model paths. Therefore, I feel like it must have happened with other teams as well, please comment if your submission failed too.
\nAs there are only two submissions allowed per day and competition is within last few days, I request kaggle team to provide extra submissions/days. {If it's a problem from their end}
\nI'm scared to do another submission right now..
EDIT: Both submissions failed to be scored.
", "messages": [ { "id": 1325493, "postDate": "2021-05-27T19:36:50.257Z", "content": "My submission failed even though I didn't made any change in the yesterday's successful inference code apart from model paths. Therefore, I feel like it must have happened with other teams as well, please comment if your submission failed too.
\nAs there are only two submissions allowed per day and competition is within last few days, I request kaggle team to provide extra submissions/days. {If it's a problem from their end}
\nI'm scared to do another submission right now..
EDIT: Both submissions failed to be scored.
", "rawMarkdown": "My submission failed even though I didn't made any change in the yesterday's successful inference code apart from model paths. Therefore, I feel like it must have happened with other teams as well, please comment if your submission failed too. \n\nAs there are only two submissions allowed per day and competition is within last few days, I request kaggle team to provide extra submissions/days. {If it's a problem from their end}\nI'm scared to do another submission right now..\n\n**EDIT**: Both submissions failed to be scored.", "votes": 34 }, { "id": 1326197, "postDate": "2021-05-28T09:57:10.167Z", "content": "This is all very unfortunate, and yet, as organizers, there is not much we can do. I reached out to Kaggle and hopefully we will find a solution before the deadline. Thanks everyone for your patience.
", "rawMarkdown": "This is all very unfortunate, and yet, as organizers, there is not much we can do. I reached out to Kaggle and hopefully we will find a solution before the deadline. Thanks everyone for your patience.", "votes": 8, "replies": [ { "id": 1326206, "postDate": "2021-05-28T10:03:27.187Z", "content": "Thanks for your support @stefankahl. Appreciate it.
", "rawMarkdown": "Thanks for your support @stefankahl. Appreciate it.\n", "votes": 1 } ] }, { "id": 1325595, "postDate": "2021-05-27T21:06:02.310Z", "content": "I also had an error with my last sub. This is the first time. And the submission is real close to a previous one that scored correctly.
", "rawMarkdown": "I also had an error with my last sub. This is the first time. And the submission is real close to a previous one that scored correctly.\n\n", "votes": 4, "replies": [ { "id": 1325599, "postDate": "2021-05-27T21:07:07.233Z", "content": "Thank you for confirming. 👍
", "rawMarkdown": "Thank you for confirming. 👍" }, { "id": 1325639, "postDate": "2021-05-27T22:00:28.967Z", "content": "Does the error look as if the test data were not loaded? giving the base score of 0.54?
", "rawMarkdown": "Does the error look as if the test data were not loaded? giving the base score of 0.54?" }, { "id": 1325643, "postDate": "2021-05-27T22:08:36.713Z", "content": "No it gives submission error. There is something wrong with the scoring as in other comps I assume.
", "rawMarkdown": "No it gives submission error. There is something wrong with the scoring as in other comps I assume.", "votes": 1 } ] }, { "id": 1326204, "postDate": "2021-05-28T10:01:55.180Z", "content": "Ok that’s why the sudden error 👍 Why don’t give it an extra week extension, just to make sure everything is alright, alright? 😉
\nUpdate: Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week.
\nMaybe one shouldn’t make such joke within the intense final competing hours, it seems 😉
😏
\nI'm afraid that won't work. We have a working note submission deadline coming up and we need to validate the leaderboard before that so that everyone knows their official score. However, we'll try to work something out (let's hope that it actually does work out with the weekend and a U.S. holiday coming up).
", "rawMarkdown": "😏\n\nI'm afraid that won't work. We have a working note submission deadline coming up and we need to validate the leaderboard before that so that everyone knows their official score. However, we'll try to work something out (let's hope that it actually does work out with the weekend and a U.S. holiday coming up). ", "votes": 1 }, { "id": 1326279, "postDate": "2021-05-28T11:18:16.660Z", "content": "Would it be possible to just increase the number of submissions allowed for the last few days to make up for it?
", "rawMarkdown": "Would it be possible to just increase the number of submissions allowed for the last few days to make up for it?" }, { "id": 1326288, "postDate": "2021-05-28T11:29:26.747Z", "content": "@stefankahl thanks for replying and support: do you have an idea when you will be able to provide us an answer?
", "rawMarkdown": "@stefankahl thanks for replying and support: do you have an idea when you will be able to provide us an answer?", "votes": 1 }, { "id": 1326290, "postDate": "2021-05-28T11:30:16.720Z", "content": "\n\nincrease the number of submissions allowed for the last few days to make up for it
\n
I don't think that will be fair.
\nThe best solution IMHO is to find a way to give a scoring to the failed submissions only (or allow to rerun/resubmit the same version)
", "rawMarkdown": "> increase the number of submissions allowed for the last few days to make up for it\n\n\nI don't think that will be fair. \n\nThe best solution IMHO is to find a way to give a scoring to the failed submissions only (or allow to rerun/resubmit the same version) ", "votes": 1 }, { "id": 1326300, "postDate": "2021-05-28T11:35:45.630Z", "content": "Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week.
", "rawMarkdown": "Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week. \n", "votes": 2 }, { "id": 1326341, "postDate": "2021-05-28T12:11:11.430Z", "content": "One day extension seems reasonable to me, We couldn't plan more yesterday without having a successful submission. It must be the case for many other teams as well.
", "rawMarkdown": "One day extension seems reasonable to me, We couldn't plan more yesterday without having a successful submission. It must be the case for many other teams as well. " }, { "id": 1326362, "postDate": "2021-05-28T12:26:54.410Z", "content": "\n\ndo you have an idea when you will be able to provide us an answer?
\n
No, unfortunately not, I am waiting for a reply. But I sincerely hope that we can make it work before the deadline. I'll keep you posted.
", "rawMarkdown": "> do you have an idea when you will be able to provide us an answer?\n\nNo, unfortunately not, I am waiting for a reply. But I sincerely hope that we can make it work before the deadline. I'll keep you posted.", "votes": 2 }, { "id": 1326369, "postDate": "2021-05-28T12:32:34.067Z", "content": "\n\nOne day extension seems reasonable to me
\n
This would be unfair as some people did have 2 successful submissions yesterday when other had none. Rerunning the failed submissions would be fairer.
", "rawMarkdown": "> One day extension seems reasonable to me\n\nThis would be unfair as some people did have 2 successful submissions yesterday when other had none. Rerunning the failed submissions would be fairer.", "votes": 4 }, { "id": 1326401, "postDate": "2021-05-28T13:07:28.597Z", "content": "To be clear, I had one successful sub yesterday, and I am thinking about those who lost 2 subs still.
", "rawMarkdown": "To be clear, I had one successful sub yesterday, and I am thinking about those who lost 2 subs still." } ] }, { "id": 1327110, "postDate": "2021-05-28T23:15:46.050Z", "content": "Wow - this is like if a big chunk of Extra Time was added to a heavily contested soccer match. And there's significant movement at the top of the LB. Talk about drama!
\nDo people expect a shake-up? Or does CV match LB perfectly?
\n(Spectator watching with popcorn)
", "rawMarkdown": "Wow - this is like if a big chunk of Extra Time was added to a heavily contested soccer match. And there's significant movement at the top of the LB. Talk about drama!\n\nDo people expect a shake-up? Or does CV match LB perfectly? \n\n(Spectator watching with popcorn)", "votes": 1, "replies": [ { "id": 1327125, "postDate": "2021-05-29T00:24:28.403Z", "content": "How is Coleridge? I left because of target and metric definition issues but I see there has bene changes. LB isn't moving much there it seems.
", "rawMarkdown": "How is Coleridge? I left because of target and metric definition issues but I see there has bene changes. LB isn't moving much there it seems.", "votes": 1 }, { "id": 1327130, "postDate": "2021-05-29T00:38:11.547Z", "content": "https://www.kaggle.com/c/coleridgeinitiative-show-us-the-data/discussion/242352
\nIn short, same issues with metric and LB split
", "rawMarkdown": "https://www.kaggle.com/c/coleridgeinitiative-show-us-the-data/discussion/242352\n\nIn short, same issues with metric and LB split", "votes": 1 } ] }, { "id": 1325737, "postDate": "2021-05-28T01:21:46.050Z", "content": "I have the same issue too.
\nI checked csv format on train soundscape data.
\nI'm pretty confident that there is no formatting error both on train and test.
Me too.
\n2 submission Scoring Error.
same here. 2 submission errors
", "rawMarkdown": "same here. 2 submission errors", "votes": 1 }, { "id": 1325665, "postDate": "2021-05-27T23:14:59.400Z", "content": "FYI we got also a sub scoring error (submitted 30 mins ago)
", "rawMarkdown": "FYI we got also a sub scoring error (submitted 30 mins ago)", "votes": 1 }, { "id": 1325660, "postDate": "2021-05-27T23:04:51.523Z", "content": "Just confirming submission scoring error. Minimal changes to the notebook.
", "rawMarkdown": "Just confirming submission scoring error. Minimal changes to the notebook.", "votes": 1 }, { "id": 1325624, "postDate": "2021-05-27T21:25:50.333Z", "content": "Yeah, I had the same issue :(
", "rawMarkdown": "Yeah, I had the same issue :( ", "votes": 1 }, { "id": 1325542, "postDate": "2021-05-27T20:25:28.603Z", "content": "Don't panic, your submission fails because you change the model you use. Focus on that and you'll find what is wrong. Checking that the path you use is valid is only a first step.
", "rawMarkdown": "Don't panic, your submission fails because you change the model you use. Focus on that and you'll find what is wrong. Checking that the path you use is valid is only a first step.", "votes": 1, "replies": [ { "id": 1325551, "postDate": "2021-05-27T20:33:36.207Z", "content": "@cpmpml checked and submitted again and got an error again ☹️
", "rawMarkdown": "@cpmpml checked and submitted again and got an error again ☹️" }, { "id": 1325554, "postDate": "2021-05-27T20:34:01.460Z", "content": "I cross checked inference code and submitted after getting motivated from you, got the error again. :)
\nAlso I didn't changed model, just weights.
did your recent sub work @cpmpml ? - I assume some are put onto different hardware and then it fails
", "rawMarkdown": "did your recent sub work @cpmpml ? - I assume some are put onto different hardware and then it fails", "votes": 1 } ] }, { "id": 1325531, "postDate": "2021-05-27T20:07:15.283Z", "content": "@nischaydnk please check if after clicking \"Save and Run all\" the notebook, you can see the \"submission.csv\" in output in the new version. Also, check that internet is off.
", "rawMarkdown": "@nischaydnk please check if after clicking \"Save and Run all\" the notebook, you can see the \"submission.csv\" in output in the new version. Also, check that internet is off. ", "votes": 1 }, { "id": 1325498, "postDate": "2021-05-27T19:43:14.043Z", "content": "@inversion maybe you can have a look. The submissions are really important for us as the days and submission both are hard to come by in this competition. This competition has lit up in the last 4 days and everyone is fitting for that extra mile, thus every submission becomes 10x more important
", "rawMarkdown": "@inversion maybe you can have a look. The submissions are really important for us as the days and submission both are hard to come by in this competition. This competition has lit up in the last 4 days and everyone is fitting for that extra mile, thus every submission becomes 10x more important ", "votes": 1 }, { "id": 1326077, "postDate": "2021-05-28T07:57:34.313Z", "content": "Update: Just submitted. It was successful.
", "rawMarkdown": "Update: Just submitted. It was successful.", "votes": 2, "replies": [ { "id": 1326149, "postDate": "2021-05-28T08:54:40.143Z", "content": "Thank you for info!
", "rawMarkdown": "Thank you for info!", "votes": 1 } ] }, { "id": 1325860, "postDate": "2021-05-28T04:34:16.807Z", "content": "@kneroma I see you just submitted. Was your sub successful? I mean, did it run without error?
", "rawMarkdown": "@kneroma I see you just submitted. Was your sub successful? I mean, did it run without error?", "votes": 2, "replies": [ { "id": 1327118, "postDate": "2021-05-28T23:35:01.987Z", "content": "Sorry for my late answer. Yes It was succesful ! Perhaps, I was just lucky enough.
", "rawMarkdown": "Sorry for my late answer. Yes It was succesful ! Perhaps, I was just lucky enough.", "votes": 2 } ] }, { "id": 1325688, "postDate": "2021-05-28T00:08:58.900Z", "content": "I got also two times today this issue, I thought I was the only one … thank for raising this issue
", "rawMarkdown": "I got also two times today this issue, I thought I was the only one ... thank for raising this issue", "votes": 2 }, { "id": 1325605, "postDate": "2021-05-27T21:09:55.200Z", "content": "Given a number of us experience a submission error it is likely an issue on Kaggle side.
\nIf this is confirmed then I support the idea of giving back subs that failed because of the systemj failure.
\nI don't support a deadline extension though, for two reasons:
\nI have a better proposal: let's stop the competition right now ;)
", "rawMarkdown": "I have a better proposal: let's stop the competition right now ;)", "votes": 1 }, { "id": 1325618, "postDate": "2021-05-27T21:18:49.703Z", "content": "This is always painful when you are on top and others have failing submissions, I know that feeling because you are the last person who would like to have an extension. In the past if it happened shortly before deadline there usually has been an extension.
\nApparently it is also not working in BMS, so maybe they will extend both competitions by a day.
\nGiving everyone extra subs tomorrow if they had failing ones today would be probably the most fair solution. But I am not sure if this is technically possible to quickly implement.
", "rawMarkdown": "This is always painful when you are on top and others have failing submissions, I know that feeling because you are the last person who would like to have an extension. In the past if it happened shortly before deadline there usually has been an extension.\n\nApparently it is also not working in BMS, so maybe they will extend both competitions by a day.\n\nGiving everyone extra subs tomorrow if they had failing ones today would be probably the most fair solution. But I am not sure if this is technically possible to quickly implement.", "votes": 2 }, { "id": 1325653, "postDate": "2021-05-27T22:33:25.503Z", "content": "The fairest is to rerun the failed subs and not extend the competition IMHO. But I'l take whatever they decide and fight till the end ;)
", "rawMarkdown": "The fairest is to rerun the failed subs and not extend the competition IMHO. But I'l take whatever they decide and fight till the end ;)", "votes": 4 }, { "id": 1326256, "postDate": "2021-05-28T11:03:10.540Z", "content": "What about those who didn't submit their originally planned submissions, because of the failure? Also, there must be a lot of submissions that are the same, that were submitted just to see if the error is still there. Rerunning all those is, not what they meant… An easy check could solve this same submission issue, but still, I'm sure that people behave much more differently if there is a known error with submitting, and so I don't think that the fairest thing is to just rerun the failed subs.
\nI think it would be more fair if everybody would get as many submission possibilities as they didn't use up on days that there was an error. Or something like that.
", "rawMarkdown": "What about those who didn't submit their originally planned submissions, because of the failure? Also, there must be a lot of submissions that are the same, that were submitted just to see if the error is still there. Rerunning all those is, not what they meant... An easy check could solve this same submission issue, but still, I'm sure that people behave much more differently if there is a known error with submitting, and so I don't think that the fairest thing is to just rerun the failed subs.\n\nI think it would be more fair if everybody would get as many submission possibilities as they didn't use up on days that there was an error. Or something like that.", "votes": 1 } ] }, { "id": 1325562, "postDate": "2021-05-27T20:39:30.253Z", "content": "Inference speed does seem to be significantly different, too, comparing to identical kernels earlier.
\nMaybe some hardware changes?
Hmm, it reduced a bit in my case. same goes for yours?
", "rawMarkdown": "Hmm, it reduced a bit in my case. same goes for yours?", "votes": 1 }, { "id": 1325564, "postDate": "2021-05-27T20:41:51.690Z", "content": "it reduced quite significantly actually, ~20%
\nactually also our sub ran faster than usually, and then got the error
", "rawMarkdown": "it reduced quite significantly actually, ~20%\n\nactually also our sub ran faster than usually, and then got the error", "votes": 1 } ] }, { "id": 1325550, "postDate": "2021-05-27T20:33:30.430Z", "content": "I faced the same problem today. 2 submissions failed. I only removed models in the ensemble and adjusted a threshold, so nothing that should have caused any error.
", "rawMarkdown": "I faced the same problem today. 2 submissions failed. I only removed models in the ensemble and adjusted a threshold, so nothing that should have caused any error.", "votes": 2 }, { "id": 1325547, "postDate": "2021-05-27T20:32:09.037Z", "content": "You are right, we also just got an error on a sub, so something should be wrong :(
\nThis is indeed very problematic given only 2 subs per day and handful of days left. This hurts us a lot.
\n@addisonhoward
\"No additional details provided for this error.\"
\nYeah, thanks
Thanks for confirming @philippsinger 😏😏
", "rawMarkdown": "Thanks for confirming @philippsinger 😏😏", "votes": 1 } ] }, { "id": 1325896, "postDate": "2021-05-28T05:16:58.277Z", "content": "Hey all - please take a look here.
", "rawMarkdown": "Hey all - please take a look [here](https://www.kaggle.com/general/242190).", "replies": [ { "id": 1325901, "postDate": "2021-05-28T05:19:37.880Z", "content": "\nWill you rerun the failed submissions?
", "rawMarkdown": "@addisonhoward \n\nWill you rerun the failed submissions?", "votes": 1 }, { "id": 1325909, "postDate": "2021-05-28T05:23:39.580Z", "content": "Edited as ranting does not help.
", "rawMarkdown": "Edited as ranting does not help." }, { "id": 1325970, "postDate": "2021-05-28T06:20:21.890Z", "content": "How is this fair to the teams who submitted in that time duration and was waiting for kaggle's response ? @addisonhoward
", "rawMarkdown": "How is this fair to the teams who submitted in that time duration and was waiting for kaggle's response ? @addisonhoward ", "votes": 1 }, { "id": 1325989, "postDate": "2021-05-28T06:39:08.363Z", "content": "It is unfair. I hope many will protest until a fix is proposed.
", "rawMarkdown": "It is unfair. I hope many will protest until a fix is proposed.", "votes": 2 }, { "id": 1326005, "postDate": "2021-05-28T06:46:46.863Z", "content": "Hi @addisonhoward - could you please give us clear feedback if it is working now again and also whether there are any plans to re-compensate the failed subs? This competition has 2 daily subs allowance and we are close to deadline, you have to understand that many are impacted quite a bit if subs fail.
", "rawMarkdown": "Hi @addisonhoward - could you please give us clear feedback if it is working now again and also whether there are any plans to re-compensate the failed subs? This competition has 2 daily subs allowance and we are close to deadline, you have to understand that many are impacted quite a bit if subs fail.", "votes": 7 }, { "id": 1326054, "postDate": "2021-05-28T07:30:56.773Z", "content": "Hey, @addisonhoward I think it will be fair to rerun the submissions of people who submitted in the timeline when there was an outage. The 2 submission limit in this competition makes every sub extremely valuable.
", "rawMarkdown": "Hey, @addisonhoward I think it will be fair to rerun the submissions of people who submitted in the timeline when there was an outage. The 2 submission limit in this competition makes every sub extremely valuable. ", "votes": 1 }, { "id": 1326055, "postDate": "2021-05-28T07:33:48.373Z", "content": "@addisonhoward kindly provide a small update asap in forums of active competitions if there is such an outage. It will save us from the unwanted stress 😬
", "rawMarkdown": "@addisonhoward kindly provide a small update asap in forums of active competitions if there is such an outage. It will save us from the unwanted stress 😬", "votes": 1 }, { "id": 1326726, "postDate": "2021-05-28T16:33:06.280Z", "content": "Hi all,
\nPlease standby - we're working on a resolution now and will create a separate forum post with additional details.
", "rawMarkdown": "Hi all,\n\nPlease standby - we're working on a resolution now and will create a separate forum post with additional details.", "votes": 2 }, { "id": 1326758, "postDate": "2021-05-28T16:59:37.247Z", "content": "Can you please create a separate forum right now in this competition so that everyone can keep track in that forum. Once it's fixed you can update everyone again. I submitted sometimes before and got error and felt really bad thinking that I wasted one submission of my team.
\nThanks
", "rawMarkdown": "Can you please create a separate forum right now in this competition so that everyone can keep track in that forum. Once it's fixed you can update everyone again. I submitted sometimes before and got error and felt really bad thinking that I wasted one submission of my team. \n\nThanks" } ] }, { "id": 1325520, "postDate": "2021-05-27T19:59:17.347Z", "content": "As always: you can see on the LB that there are many successful subs, so it is most likely on your side. Changing model paths is obviously a change that can lead to errors.
\nEdit: there are unexpected errors
How do you check successful subs @philippsinger ?? If you'll have a look on leaderboard, our last successful was submission was yesterday but it's showing 1 hour ago on leaderboard. Could be the case for other teams as well?
\nUmm, I think it could have generated error within the notebook if there were any issues with path which I've already verified twice before inference.
You are right, also just got an error.
", "rawMarkdown": "You are right, also just got an error.", "votes": 3 } ] }, { "id": 1329121, "postDate": "2021-05-30T21:28:03.153Z", "content": "I have just lost both of my submissions. The error is still there! :(
", "rawMarkdown": "I have just lost both of my submissions. The error is still there! :(", "replies": [ { "id": 1329133, "postDate": "2021-05-30T21:43:08.230Z", "content": "I submitted a notebook two hours ago, it run for ~1.5 hours and succeeded. Are you sure that in this case it is not your mistake?
", "rawMarkdown": "I submitted a notebook two hours ago, it run for ~1.5 hours and succeeded. Are you sure that in this case it is not your mistake?", "votes": 2 }, { "id": 1329137, "postDate": "2021-05-30T21:57:43.960Z", "content": "Yesterday, I had two successful submissions with the same code just with different models. I guess it's not from my side. I will try it tomorrow and hope to have successful submissions.
", "rawMarkdown": "Yesterday, I had two successful submissions with the same code just with different models. I guess it's not from my side. I will try it tomorrow and hope to have successful submissions. " } ] }, { "id": 1326715, "postDate": "2021-05-28T16:20:44.450Z", "content": "Is it working now? I just made submission and I got error, not sure if it was because of something else or this issue.
", "rawMarkdown": "Is it working now? I just made submission and I got error, not sure if it was because of something else or this issue. ", "replies": [ { "id": 1326725, "postDate": "2021-05-28T16:32:45.773Z", "content": "also curious, did anyone recently did a successful sub?
", "rawMarkdown": "also curious, did anyone recently did a successful sub?" }, { "id": 1326730, "postDate": "2021-05-28T16:39:09.197Z", "content": "I can see several teams have submitted a few hours ago but not sure if it worked for them or not.
", "rawMarkdown": "I can see several teams have submitted a few hours ago but not sure if it worked for them or not. " }, { "id": 1326791, "postDate": "2021-05-28T17:30:07.200Z", "content": "\n\nThe same yesterday failed sub worked for me now 2h ago.
\n
Now 7h ago. Maybe the problem is still here but it worked then.
", "rawMarkdown": "> The same yesterday failed sub worked for me now 2h ago.\n\nNow 7h ago. Maybe the problem is still here but it worked then.\n" }, { "id": 1326803, "postDate": "2021-05-28T17:35:53.617Z", "content": "Ok, thanks for the information. In one comment below Kaggle staff said that they are still fixing the issue. So don't know if yours worked while it was fixed and mine failed. Let's hope for the clear information soon.
", "rawMarkdown": "Ok, thanks for the information. In one comment below Kaggle staff said that they are still fixing the issue. So don't know if yours worked while it was fixed and mine failed. Let's hope for the clear information soon." }, { "id": 1326811, "postDate": "2021-05-28T17:44:26.410Z", "content": "Yes sounds wise, gamble with the 2 subs just a few days left, better to be 100% sure.
\nI did a try and it worked then but I suggest waiting if the there is still information of issues or not confirmed solved.
subs are working, at least one worked for us and apparently lots of movement on lb happening
", "rawMarkdown": "subs are working, at least one worked for us and apparently lots of movement on lb happening", "votes": 2 } ] }, { "id": 1326286, "postDate": "2021-05-28T11:27:54.200Z", "content": "Does anyone know if the submissions are working again?
", "rawMarkdown": "Does anyone know if the submissions are working again?", "replies": [ { "id": 1326303, "postDate": "2021-05-28T11:39:30.623Z", "content": "Yes it's working.
\nAnd thanks to the team(kaggle/host) solving the issue, and giving quick answers/support 🙏
Someone reported it is not working two hour ago in the main forum: https://www.kaggle.com/general/242190#1326258
", "rawMarkdown": "Someone reported it is not working two hour ago in the main forum: https://www.kaggle.com/general/242190#1326258\n\n", "votes": 1 }, { "id": 1326374, "postDate": "2021-05-28T12:38:12.720Z", "content": "OK. The same yesterday failed sub worked for me now 2h ago.
", "rawMarkdown": "OK. The same yesterday failed sub worked for me now 2h ago.", "votes": 2 } ] }, { "id": 1325773, "postDate": "2021-05-28T02:02:55.450Z", "content": "Is Scoring Error counted in submissions?
\nWhen I got a Kaggle Error, I was able to submit it again.
Edit: I just submitted, It seems to be counted because it says \"You have 1 submissions remaining today. Submissions reset daily.\" ……
", "rawMarkdown": "Is Scoring Error counted in submissions?\nWhen I got a Kaggle Error, I was able to submit it again.\n\nEdit: I just submitted, It seems to be counted because it says \"You have 1 submissions remaining today. Submissions reset daily.\" ......", "replies": [ { "id": 1325861, "postDate": "2021-05-28T04:34:40.790Z", "content": "did your sub completed successfully?
", "rawMarkdown": "did your sub completed successfully?" }, { "id": 1325874, "postDate": "2021-05-28T04:45:25.917Z", "content": "I failed to submit
", "rawMarkdown": "I failed to submit", "votes": 1 } ] }, { "id": 1325703, "postDate": "2021-05-28T00:39:46.093Z", "rawMarkdown": "", "votes": 1, "isDeleted": true } ], "comments": [ { "id": 1326197, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-05-28T09:57:10.167000", "content": "This is all very unfortunate, and yet, as organizers, there is not much we can do. I reached out to Kaggle and hopefully we will find a solution before the deadline. Thanks everyone for your patience.
", "votes": 8, "replies": [ { "id": 1326206, "author_name": "LPLenka", "author_url": "", "post_date": "2021-05-28T10:03:27.187000", "content": "Thanks for your support @stefankahl. Appreciate it.
", "votes": 1, "replies": [] } ] }, { "id": 1325595, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-27T21:06:02.310000", "content": "I also had an error with my last sub. This is the first time. And the submission is real close to a previous one that scored correctly.
", "votes": 4, "replies": [ { "id": 1325599, "author_name": "Nischay Dhankhar", "author_url": "", "post_date": "2021-05-27T21:07:07.233000", "content": "Thank you for confirming. 👍
", "votes": 0, "replies": [] }, { "id": 1325639, "author_name": "Marcelo Kittlein", "author_url": "", "post_date": "2021-05-27T22:00:28.967000", "content": "Does the error look as if the test data were not loaded? giving the base score of 0.54?
", "votes": 0, "replies": [] }, { "id": 1325643, "author_name": "Psi", "author_url": "", "post_date": "2021-05-27T22:08:36.713000", "content": "No it gives submission error. There is something wrong with the scoring as in other comps I assume.
", "votes": 1, "replies": [] } ] }, { "id": 1326204, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T10:01:55.180000", "content": "Ok that’s why the sudden error 👍 Why don’t give it an extra week extension, just to make sure everything is alright, alright? 😉
\nUpdate: Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week.
\nMaybe one shouldn’t make such joke within the intense final competing hours, it seems 😉
😏
\nI'm afraid that won't work. We have a working note submission deadline coming up and we need to validate the leaderboard before that so that everyone knows their official score. However, we'll try to work something out (let's hope that it actually does work out with the weekend and a U.S. holiday coming up).
", "votes": 1, "replies": [] }, { "id": 1326279, "author_name": "Andrew Shao", "author_url": "", "post_date": "2021-05-28T11:18:16.660000", "content": "Would it be possible to just increase the number of submissions allowed for the last few days to make up for it?
", "votes": 0, "replies": [] }, { "id": 1326288, "author_name": "Psi", "author_url": "", "post_date": "2021-05-28T11:29:26.747000", "content": "@stefankahl thanks for replying and support: do you have an idea when you will be able to provide us an answer?
", "votes": 1, "replies": [] }, { "id": 1326290, "author_name": "Ioannis M", "author_url": "", "post_date": "2021-05-28T11:30:16.720000", "content": "\n\nincrease the number of submissions allowed for the last few days to make up for it
\n
I don't think that will be fair.
\nThe best solution IMHO is to find a way to give a scoring to the failed submissions only (or allow to rerun/resubmit the same version)
", "votes": 1, "replies": [] }, { "id": 1326300, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T11:35:45.630000", "content": "Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week.
", "votes": 2, "replies": [] }, { "id": 1326341, "author_name": "Nischay Dhankhar", "author_url": "", "post_date": "2021-05-28T12:11:11.430000", "content": "One day extension seems reasonable to me, We couldn't plan more yesterday without having a successful submission. It must be the case for many other teams as well.
", "votes": 0, "replies": [] }, { "id": 1326362, "author_name": "Stefan Kahl", "author_url": "", "post_date": "2021-05-28T12:26:54.410000", "content": "\n\ndo you have an idea when you will be able to provide us an answer?
\n
No, unfortunately not, I am waiting for a reply. But I sincerely hope that we can make it work before the deadline. I'll keep you posted.
", "votes": 2, "replies": [] }, { "id": 1326369, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T12:32:34.067000", "content": "\n\nOne day extension seems reasonable to me
\n
This would be unfair as some people did have 2 successful submissions yesterday when other had none. Rerunning the failed submissions would be fairer.
", "votes": 4, "replies": [] }, { "id": 1326401, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T13:07:28.597000", "content": "To be clear, I had one successful sub yesterday, and I am thinking about those who lost 2 subs still.
", "votes": 0, "replies": [] } ] }, { "id": 1327110, "author_name": "Chun Ming Lee", "author_url": "", "post_date": "2021-05-28T23:15:46.050000", "content": "Wow - this is like if a big chunk of Extra Time was added to a heavily contested soccer match. And there's significant movement at the top of the LB. Talk about drama!
\nDo people expect a shake-up? Or does CV match LB perfectly?
\n(Spectator watching with popcorn)
", "votes": 1, "replies": [ { "id": 1327125, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-29T00:24:28.403000", "content": "How is Coleridge? I left because of target and metric definition issues but I see there has bene changes. LB isn't moving much there it seems.
", "votes": 1, "replies": [] }, { "id": 1327130, "author_name": "Chun Ming Lee", "author_url": "", "post_date": "2021-05-29T00:38:11.547000", "content": "https://www.kaggle.com/c/coleridgeinitiative-show-us-the-data/discussion/242352
\nIn short, same issues with metric and LB split
", "votes": 1, "replies": [] } ] }, { "id": 1325737, "author_name": "Masanori Nakazato", "author_url": "", "post_date": "2021-05-28T01:21:46.050000", "content": "I have the same issue too.
\nI checked csv format on train soundscape data.
\nI'm pretty confident that there is no formatting error both on train and test.
Me too.
\n2 submission Scoring Error.
same here. 2 submission errors
", "votes": 1, "replies": [] }, { "id": 1325665, "author_name": "Ioannis M", "author_url": "", "post_date": "2021-05-27T23:14:59.400000", "content": "FYI we got also a sub scoring error (submitted 30 mins ago)
", "votes": 1, "replies": [] }, { "id": 1325660, "author_name": "fffrrt", "author_url": "", "post_date": "2021-05-27T23:04:51.523000", "content": "Just confirming submission scoring error. Minimal changes to the notebook.
", "votes": 1, "replies": [] }, { "id": 1325624, "author_name": "Zaber Ibn Abdul Hakim", "author_url": "", "post_date": "2021-05-27T21:25:50.333000", "content": "Yeah, I had the same issue :(
", "votes": 1, "replies": [] }, { "id": 1325542, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-27T20:25:28.603000", "content": "Don't panic, your submission fails because you change the model you use. Focus on that and you'll find what is wrong. Checking that the path you use is valid is only a first step.
", "votes": 1, "replies": [ { "id": 1325551, "author_name": "Mr_KnowNothing", "author_url": "", "post_date": "2021-05-27T20:33:36.207000", "content": "@cpmpml checked and submitted again and got an error again ☹️
", "votes": 0, "replies": [] }, { "id": 1325554, "author_name": "Nischay Dhankhar", "author_url": "", "post_date": "2021-05-27T20:34:01.460000", "content": "I cross checked inference code and submitted after getting motivated from you, got the error again. :)
\nAlso I didn't changed model, just weights.
did your recent sub work @cpmpml ? - I assume some are put onto different hardware and then it fails
", "votes": 1, "replies": [] } ] }, { "id": 1325531, "author_name": "LPLenka", "author_url": "", "post_date": "2021-05-27T20:07:15.283000", "content": "@nischaydnk please check if after clicking \"Save and Run all\" the notebook, you can see the \"submission.csv\" in output in the new version. Also, check that internet is off.
", "votes": 1, "replies": [] }, { "id": 1325498, "author_name": "Mr_KnowNothing", "author_url": "", "post_date": "2021-05-27T19:43:14.043000", "content": "@inversion maybe you can have a look. The submissions are really important for us as the days and submission both are hard to come by in this competition. This competition has lit up in the last 4 days and everyone is fitting for that extra mile, thus every submission becomes 10x more important
", "votes": 1, "replies": [] }, { "id": 1326077, "author_name": "sin", "author_url": "", "post_date": "2021-05-28T07:57:34.313000", "content": "Update: Just submitted. It was successful.
", "votes": 2, "replies": [ { "id": 1326149, "author_name": "Ioannis M", "author_url": "", "post_date": "2021-05-28T08:54:40.143000", "content": "Thank you for info!
", "votes": 1, "replies": [] } ] }, { "id": 1325860, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T04:34:16.807000", "content": "@kneroma I see you just submitted. Was your sub successful? I mean, did it run without error?
", "votes": 2, "replies": [ { "id": 1327118, "author_name": "kkiller", "author_url": "", "post_date": "2021-05-28T23:35:01.987000", "content": "Sorry for my late answer. Yes It was succesful ! Perhaps, I was just lucky enough.
", "votes": 2, "replies": [] } ] }, { "id": 1325688, "author_name": "Shiro", "author_url": "", "post_date": "2021-05-28T00:08:58.900000", "content": "I got also two times today this issue, I thought I was the only one … thank for raising this issue
", "votes": 2, "replies": [] }, { "id": 1325605, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-27T21:09:55.200000", "content": "Given a number of us experience a submission error it is likely an issue on Kaggle side.
\nIf this is confirmed then I support the idea of giving back subs that failed because of the systemj failure.
\nI don't support a deadline extension though, for two reasons:
\nI have a better proposal: let's stop the competition right now ;)
", "votes": 1, "replies": [] }, { "id": 1325618, "author_name": "Psi", "author_url": "", "post_date": "2021-05-27T21:18:49.703000", "content": "This is always painful when you are on top and others have failing submissions, I know that feeling because you are the last person who would like to have an extension. In the past if it happened shortly before deadline there usually has been an extension.
\nApparently it is also not working in BMS, so maybe they will extend both competitions by a day.
\nGiving everyone extra subs tomorrow if they had failing ones today would be probably the most fair solution. But I am not sure if this is technically possible to quickly implement.
", "votes": 2, "replies": [] }, { "id": 1325653, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-27T22:33:25.503000", "content": "The fairest is to rerun the failed subs and not extend the competition IMHO. But I'l take whatever they decide and fight till the end ;)
", "votes": 4, "replies": [] }, { "id": 1326256, "author_name": "nofreewill42", "author_url": "", "post_date": "2021-05-28T11:03:10.540000", "content": "What about those who didn't submit their originally planned submissions, because of the failure? Also, there must be a lot of submissions that are the same, that were submitted just to see if the error is still there. Rerunning all those is, not what they meant… An easy check could solve this same submission issue, but still, I'm sure that people behave much more differently if there is a known error with submitting, and so I don't think that the fairest thing is to just rerun the failed subs.
\nI think it would be more fair if everybody would get as many submission possibilities as they didn't use up on days that there was an error. Or something like that.
", "votes": 1, "replies": [] } ] }, { "id": 1325562, "author_name": "Pascal Pfeiffer", "author_url": "", "post_date": "2021-05-27T20:39:30.253000", "content": "Inference speed does seem to be significantly different, too, comparing to identical kernels earlier.
\nMaybe some hardware changes?
Hmm, it reduced a bit in my case. same goes for yours?
", "votes": 1, "replies": [] }, { "id": 1325564, "author_name": "Psi", "author_url": "", "post_date": "2021-05-27T20:41:51.690000", "content": "it reduced quite significantly actually, ~20%
\nactually also our sub ran faster than usually, and then got the error
", "votes": 1, "replies": [] } ] }, { "id": 1325550, "author_name": "adsr", "author_url": "", "post_date": "2021-05-27T20:33:30.430000", "content": "I faced the same problem today. 2 submissions failed. I only removed models in the ensemble and adjusted a threshold, so nothing that should have caused any error.
", "votes": 2, "replies": [] }, { "id": 1325547, "author_name": "Psi", "author_url": "", "post_date": "2021-05-27T20:32:09.037000", "content": "You are right, we also just got an error on a sub, so something should be wrong :(
\nThis is indeed very problematic given only 2 subs per day and handful of days left. This hurts us a lot.
\n@addisonhoward
\"No additional details provided for this error.\"
\nYeah, thanks
Thanks for confirming @philippsinger 😏😏
", "votes": 1, "replies": [] } ] }, { "id": 1325896, "author_name": "Addison Howard", "author_url": "", "post_date": "2021-05-28T05:16:58.277000", "content": "Hey all - please take a look here.
", "votes": 0, "replies": [ { "id": 1325901, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T05:19:37.880000", "content": "\nWill you rerun the failed submissions?
", "votes": 1, "replies": [] }, { "id": 1325909, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T05:23:39.580000", "content": "Edited as ranting does not help.
", "votes": 0, "replies": [] }, { "id": 1325970, "author_name": "Mr_KnowNothing", "author_url": "", "post_date": "2021-05-28T06:20:21.890000", "content": "How is this fair to the teams who submitted in that time duration and was waiting for kaggle's response ? @addisonhoward
", "votes": 1, "replies": [] }, { "id": 1325989, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T06:39:08.363000", "content": "It is unfair. I hope many will protest until a fix is proposed.
", "votes": 2, "replies": [] }, { "id": 1326005, "author_name": "Psi", "author_url": "", "post_date": "2021-05-28T06:46:46.863000", "content": "Hi @addisonhoward - could you please give us clear feedback if it is working now again and also whether there are any plans to re-compensate the failed subs? This competition has 2 daily subs allowance and we are close to deadline, you have to understand that many are impacted quite a bit if subs fail.
", "votes": 7, "replies": [] }, { "id": 1326054, "author_name": "LPLenka", "author_url": "", "post_date": "2021-05-28T07:30:56.773000", "content": "Hey, @addisonhoward I think it will be fair to rerun the submissions of people who submitted in the timeline when there was an outage. The 2 submission limit in this competition makes every sub extremely valuable.
", "votes": 1, "replies": [] }, { "id": 1326055, "author_name": "LPLenka", "author_url": "", "post_date": "2021-05-28T07:33:48.373000", "content": "@addisonhoward kindly provide a small update asap in forums of active competitions if there is such an outage. It will save us from the unwanted stress 😬
", "votes": 1, "replies": [] }, { "id": 1326726, "author_name": "Addison Howard", "author_url": "", "post_date": "2021-05-28T16:33:06.280000", "content": "Hi all,
\nPlease standby - we're working on a resolution now and will create a separate forum post with additional details.
", "votes": 2, "replies": [] }, { "id": 1326758, "author_name": "Urvish", "author_url": "", "post_date": "2021-05-28T16:59:37.247000", "content": "Can you please create a separate forum right now in this competition so that everyone can keep track in that forum. Once it's fixed you can update everyone again. I submitted sometimes before and got error and felt really bad thinking that I wasted one submission of my team.
\nThanks
", "votes": 0, "replies": [] } ] }, { "id": 1325520, "author_name": "Psi", "author_url": "", "post_date": "2021-05-27T19:59:17.347000", "content": "As always: you can see on the LB that there are many successful subs, so it is most likely on your side. Changing model paths is obviously a change that can lead to errors.
\nEdit: there are unexpected errors
How do you check successful subs @philippsinger ?? If you'll have a look on leaderboard, our last successful was submission was yesterday but it's showing 1 hour ago on leaderboard. Could be the case for other teams as well?
\nUmm, I think it could have generated error within the notebook if there were any issues with path which I've already verified twice before inference.
You are right, also just got an error.
", "votes": 3, "replies": [] } ] }, { "id": 1329121, "author_name": "Warrior", "author_url": "", "post_date": "2021-05-30T21:28:03.153000", "content": "I have just lost both of my submissions. The error is still there! :(
", "votes": 0, "replies": [ { "id": 1329133, "author_name": "fffrrt", "author_url": "", "post_date": "2021-05-30T21:43:08.230000", "content": "I submitted a notebook two hours ago, it run for ~1.5 hours and succeeded. Are you sure that in this case it is not your mistake?
", "votes": 2, "replies": [] }, { "id": 1329137, "author_name": "Warrior", "author_url": "", "post_date": "2021-05-30T21:57:43.960000", "content": "Yesterday, I had two successful submissions with the same code just with different models. I guess it's not from my side. I will try it tomorrow and hope to have successful submissions.
", "votes": 0, "replies": [] } ] }, { "id": 1326715, "author_name": "Urvish", "author_url": "", "post_date": "2021-05-28T16:20:44.450000", "content": "Is it working now? I just made submission and I got error, not sure if it was because of something else or this issue.
", "votes": 0, "replies": [ { "id": 1326725, "author_name": "Psi", "author_url": "", "post_date": "2021-05-28T16:32:45.773000", "content": "also curious, did anyone recently did a successful sub?
", "votes": 0, "replies": [] }, { "id": 1326730, "author_name": "Urvish", "author_url": "", "post_date": "2021-05-28T16:39:09.197000", "content": "I can see several teams have submitted a few hours ago but not sure if it worked for them or not.
", "votes": 0, "replies": [] }, { "id": 1326791, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T17:30:07.200000", "content": "\n\nThe same yesterday failed sub worked for me now 2h ago.
\n
Now 7h ago. Maybe the problem is still here but it worked then.
", "votes": 0, "replies": [] }, { "id": 1326803, "author_name": "Urvish", "author_url": "", "post_date": "2021-05-28T17:35:53.617000", "content": "Ok, thanks for the information. In one comment below Kaggle staff said that they are still fixing the issue. So don't know if yours worked while it was fixed and mine failed. Let's hope for the clear information soon.
", "votes": 0, "replies": [] }, { "id": 1326811, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T17:44:26.410000", "content": "Yes sounds wise, gamble with the 2 subs just a few days left, better to be 100% sure.
\nI did a try and it worked then but I suggest waiting if the there is still information of issues or not confirmed solved.
subs are working, at least one worked for us and apparently lots of movement on lb happening
", "votes": 2, "replies": [] } ] }, { "id": 1326286, "author_name": "Daniel Furman", "author_url": "", "post_date": "2021-05-28T11:27:54.200000", "content": "Does anyone know if the submissions are working again?
", "votes": 0, "replies": [ { "id": 1326303, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T11:39:30.623000", "content": "Yes it's working.
\nAnd thanks to the team(kaggle/host) solving the issue, and giving quick answers/support 🙏
Someone reported it is not working two hour ago in the main forum: https://www.kaggle.com/general/242190#1326258
", "votes": 1, "replies": [] }, { "id": 1326374, "author_name": "Kirderf", "author_url": "", "post_date": "2021-05-28T12:38:12.720000", "content": "OK. The same yesterday failed sub worked for me now 2h ago.
", "votes": 2, "replies": [] } ] }, { "id": 1325773, "author_name": "tattaka", "author_url": "", "post_date": "2021-05-28T02:02:55.450000", "content": "Is Scoring Error counted in submissions?
\nWhen I got a Kaggle Error, I was able to submit it again.
Edit: I just submitted, It seems to be counted because it says \"You have 1 submissions remaining today. Submissions reset daily.\" ……
", "votes": 0, "replies": [ { "id": 1325861, "author_name": "CPMP", "author_url": "", "post_date": "2021-05-28T04:34:40.790000", "content": "did your sub completed successfully?
", "votes": 0, "replies": [] }, { "id": 1325874, "author_name": "tattaka", "author_url": "", "post_date": "2021-05-28T04:45:25.917000", "content": "I failed to submit
", "votes": 1, "replies": [] } ] }, { "id": 1325703, "author_name": "", "author_url": "", "post_date": "2021-05-28T00:39:46.093000", "content": "", "votes": 1, "replies": [] } ], "raw_markdown_by_id": { "1325493": "My submission failed even though I didn't made any change in the yesterday's successful inference code apart from model paths. Therefore, I feel like it must have happened with other teams as well, please comment if your submission failed too. \n\nAs there are only two submissions allowed per day and competition is within last few days, I request kaggle team to provide extra submissions/days. {If it's a problem from their end}\nI'm scared to do another submission right now..\n\n**EDIT**: Both submissions failed to be scored.", "1326197": "This is all very unfortunate, and yet, as organizers, there is not much we can do. I reached out to Kaggle and hopefully we will find a solution before the deadline. Thanks everyone for your patience.", "1325595": "I also had an error with my last sub. This is the first time. And the submission is real close to a previous one that scored correctly.\n\n", "1326204": "Ok that’s why the sudden error 👍 Why don’t give it an extra week extension, just to make sure everything is alright, alright? 😉\n\nUpdate: Maybe I should underscore the 😉 emoiji. Sorry for my bad humor/irony/teasing-top-teams, already one downvote. Of course we shouldn’t extend with a week.\nMaybe one shouldn’t make such joke within the intense final competing hours, it seems 😉", "1327110": "Wow - this is like if a big chunk of Extra Time was added to a heavily contested soccer match. And there's significant movement at the top of the LB. Talk about drama!\n\nDo people expect a shake-up? Or does CV match LB perfectly? \n\n(Spectator watching with popcorn)", "1325737": "I have the same issue too.\nI checked csv format on train soundscape data.\nI'm pretty confident that there is no formatting error both on train and test.", "1325732": "Me too.\n2 submission Scoring Error.", "1325690": "same here. 2 submission errors", "1325665": "FYI we got also a sub scoring error (submitted 30 mins ago)", "1325660": "Just confirming submission scoring error. Minimal changes to the notebook.", "1325624": "Yeah, I had the same issue :( ", "1325542": "Don't panic, your submission fails because you change the model you use. Focus on that and you'll find what is wrong. Checking that the path you use is valid is only a first step.", "1325531": "@nischaydnk please check if after clicking \"Save and Run all\" the notebook, you can see the \"submission.csv\" in output in the new version. Also, check that internet is off. ", "1325498": "@inversion maybe you can have a look. The submissions are really important for us as the days and submission both are hard to come by in this competition. This competition has lit up in the last 4 days and everyone is fitting for that extra mile, thus every submission becomes 10x more important ", "1326077": "Update: Just submitted. It was successful.", "1325860": "@kneroma I see you just submitted. Was your sub successful? I mean, did it run without error?", "1325688": "I got also two times today this issue, I thought I was the only one ... thank for raising this issue", "1325605": "Given a number of us experience a submission error it is likely an issue on Kaggle side.\n\nIf this is confirmed then I support the idea of giving back subs that failed because of the systemj failure.\n\nI don't support a deadline extension though, for two reasons:\n- a personal one, that you all can ignore ofc,\n- a more generic one, this would make the deadline closer to that of BMS Molecular Translation.", "1325562": "Inference speed does seem to be significantly different, too, comparing to identical kernels earlier.\nMaybe some hardware changes?", "1325550": "I faced the same problem today. 2 submissions failed. I only removed models in the ensemble and adjusted a threshold, so nothing that should have caused any error.", "1325547": "You are right, we also just got an error on a sub, so something should be wrong :(\nThis is indeed very problematic given only 2 subs per day and handful of days left. This hurts us a lot.\n@addisonhoward ", "1325896": "Hey all - please take a look [here](https://www.kaggle.com/general/242190).", "1325520": "As always: you can see on the LB that there are many successful subs, so it is most likely on your side. Changing model paths is obviously a change that can lead to errors.\nEdit: there are unexpected errors", "1329121": "I have just lost both of my submissions. The error is still there! :(", "1326715": "Is it working now? I just made submission and I got error, not sure if it was because of something else or this issue. ", "1326286": "Does anyone know if the submissions are working again?", "1325773": "Is Scoring Error counted in submissions?\nWhen I got a Kaggle Error, I was able to submit it again.\n\nEdit: I just submitted, It seems to be counted because it says \"You have 1 submissions remaining today. Submissions reset daily.\" ......", "1325703": "" } }