![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F150865%2Fa54ee16f600e0f826ce8268613bfcd08%2FScreenshot%20from%202020-08-31%2017-45-25.png?generation=1598921383732006&alt=media\")
Yesterday I submitted version 34 of my notebook, but when I went to my submission page it had scored Version 32, which cost me submission since it ended up failing. To make sure I wasn't going crazy I decided to take a screenshot to ensure I was submitting Version 38, and now my submission page shows that it submitted Version 34 instead of Version 38. Has anyone experienced this before? How can I guarantee the correct version is being scored?
\n
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F150865%2F87e5389bd3e2bfd14d28cfcae00f4cf7%2FScreenshot%20from%202020-08-31%2017-46-13.png?generation=1598921392240270&alt=media\")
Yesterday I submitted version 34 of my notebook, but when I went to my submission page it had scored Version 32, which cost me submission since it ended up failing. To make sure I wasn't going crazy I decided to take a screenshot to ensure I was submitting Version 38, and now my submission page shows that it submitted Version 34 instead of Version 38. Has anyone experienced this before? How can I guarantee the correct version is being scored?
\n
Maybe some versions of your notebook didn't work correctly (when submitted). So the version shows different
", "rawMarkdown": "Maybe some versions of your notebook didn't work correctly (when submitted). So the version shows different", "votes": null }, { "id": "993609", "postDate": "09/01/2020 03:44:15", "content": "One thing you could do is to fork the specific version of your notebook and then submit it.
\nThe fork would have 1 version so there should not be any issues.
In my case, the submitted score is marked at the right version in the \"notebook view\" page. I think the problem is \"My Submission\" page is showing wrong version. It need to be fixed to prevent confusions
", "rawMarkdown": "In my case, the submitted score is marked at the right version in the \"notebook view\" page. I think the problem is \"My Submission\" page is showing wrong version. It need to be fixed to prevent confusions", "votes": null }, { "id": "993843", "postDate": "09/01/2020 07:17:29", "content": "It may be that the numbering is not the same. I experienced that in the past, and it looks like the versions numbers in result page are numbered by number of submission with that notebook. As a result I now fork and submit with a fresh notebook every time.
", "rawMarkdown": "It may be that the numbering is not the same. I experienced that in the past, and it looks like the versions numbers in result page are numbered by number of submission with that notebook. As a result I now fork and submit with a fresh notebook every time.", "votes": null }, { "id": "993895", "postDate": "09/01/2020 08:03:41", "content": "Numbering is not the same indeed. What I noticed - in the notebook version counter considers unfinished runs, and in the \"my submissions\" tab it does not.
\nFor example, you make a notebook, commit it and submit. Now you have v1 in the notebook and v1 in \"my subs\" tab. Then you make some changes in the code, commit it but then stop the run (this'll be v2 in notebook), make some more changes and commit again, and finally you submit. In the end you will have v3 in the notebook, but it'll be shown as v2 in \"my subs\". But if you click on the link on this v2 on \"my submissons\" tab, you'll be redirected to v3 of your notebook.
Ouch it is scary!
", "rawMarkdown": "Ouch it is scary!", "votes": null }, { "id": "994826", "postDate": "09/02/2020 01:30:57", "content": "\n\nWhat I noticed - in the notebook version counter considers unfinished runs, and in the \"my submissions\" tab it dose not.
\n
Exactly, that's what I saw as well. Thanks for being more specific than me.
", "rawMarkdown": "> What I noticed - in the notebook version counter considers unfinished runs, and in the \"my submissions\" tab it dose not. \n\nExactly, that's what I saw as well. Thanks for being more specific than me.", "votes": null }, { "id": "995439", "postDate": "09/02/2020 12:56:24", "content": "\n\nHow can I guarantee the correct version is being scored?
\n
It is the correct version. The counters are just not the same.
\nYou can verify by clicking the link of your submission in the My Submissions tab. It will link to the correct version (with a different number though).
@brandenkmurray I can confirm there is a bug as I submitted yesterday 38th version but it resulted in scoring 37th. And this morning I've just tried consciously - the same! I selected submit 39th and in a second I can see that it's evaluating 38th. That's a pitty having only 2 submissions a day!
", "rawMarkdown": "brandenkmurray I can confirm there is a bug as I submitted yesterday 38th version but it resulted in scoring 37th. And this morning I've just tried consciously - the same! I selected submit 39th and in a second I can see that it's evaluating 38th. That's a pitty having only 2 submissions a day!", "votes": null }, { "id": "1001278", "postDate": "09/07/2020 07:43:49", "content": "I bet you have a failed sub with this noebook. It explains the differenc ein nu,bering, see other comments.
", "rawMarkdown": "I bet you have a failed sub with this noebook. It explains the differenc ein nu,bering, see other comments.", "votes": null }, { "id": "1001290", "postDate": "09/07/2020 07:52:14", "content": "I'm not sure this is a good practice, but I always make a new notebook when I make a submission. In this way, at least we don't see such a problem. Hope this helps.
", "rawMarkdown": "I'm not sure this is a good practice, but I always make a new notebook when I make a submission. In this way, at least we don't see such a problem. Hope this helps.", "votes": null }, { "id": "1001334", "postDate": "09/07/2020 08:47:01", "content": "I have 0 failed submissions I'm pretty sure about it :)
\nI would agree that's only numbering discrepancy but I've committed a kernel with a bug so got a low score (586) - I've fixed it and got the same score, I've changed architecture / checkpoint / thresholds - SAME. See the image:
\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F805012%2F36deb4953bc8a02074d119c85f9ea079%2FScreenshot%20from%202020-09-07%2011-44-05.png?generation=1599468315852192&alt=media\")
Looks like some linking problem too.
\nAgree with you and @hidehisaarai1213 that better to create a new notebook every time. Unfortunately
Hi! @brandenkmurray,
\nThe same here started happening 1.5 days ago. I notice that the submission vs my latest notebook is like 2 versions behind. at this point not sure if this is a UI error or actually is submitting older versions. before Saturday was perfect.
Thanks for explaining that, I was having the same problem!
", "rawMarkdown": "Thanks for explaining that, I was having the same problem!", "votes": null } ], "comments": [ { "id": 993492, "author_name": "gzl0506", "author_url": "", "post_date": "09/01/2020 01:10:08", "content": "Maybe some versions of your notebook didn't work correctly (when submitted). So the version shows different
", "votes": null, "replies": [] }, { "id": 993609, "author_name": "oneplustricks", "author_url": "", "post_date": "09/01/2020 03:44:15", "content": "One thing you could do is to fork the specific version of your notebook and then submit it.
\nThe fork would have 1 version so there should not be any issues.
In my case, the submitted score is marked at the right version in the \"notebook view\" page. I think the problem is \"My Submission\" page is showing wrong version. It need to be fixed to prevent confusions
", "votes": null, "replies": [] }, { "id": 993843, "author_name": "cpmpml", "author_url": "", "post_date": "09/01/2020 07:17:29", "content": "It may be that the numbering is not the same. I experienced that in the past, and it looks like the versions numbers in result page are numbered by number of submission with that notebook. As a result I now fork and submit with a fresh notebook every time.
", "votes": null, "replies": [ { "id": 993895, "author_name": "stanislavblinov", "author_url": "", "post_date": "09/01/2020 08:03:41", "content": "Numbering is not the same indeed. What I noticed - in the notebook version counter considers unfinished runs, and in the \"my submissions\" tab it does not.
\nFor example, you make a notebook, commit it and submit. Now you have v1 in the notebook and v1 in \"my subs\" tab. Then you make some changes in the code, commit it but then stop the run (this'll be v2 in notebook), make some more changes and commit again, and finally you submit. In the end you will have v3 in the notebook, but it'll be shown as v2 in \"my subs\". But if you click on the link on this v2 on \"my submissons\" tab, you'll be redirected to v3 of your notebook.
\n\nWhat I noticed - in the notebook version counter considers unfinished runs, and in the \"my submissions\" tab it dose not.
\n
Exactly, that's what I saw as well. Thanks for being more specific than me.
", "votes": null, "replies": [] }, { "id": 1003032, "author_name": "ephell", "author_url": "", "post_date": "09/08/2020 16:02:12", "content": "Thanks for explaining that, I was having the same problem!
", "votes": null, "replies": [] } ] }, { "id": 994447, "author_name": "gaborfodor", "author_url": "", "post_date": "09/01/2020 15:29:24", "content": "Ouch it is scary!
", "votes": null, "replies": [] }, { "id": 995439, "author_name": "seesee", "author_url": "", "post_date": "09/02/2020 12:56:24", "content": "\n\nHow can I guarantee the correct version is being scored?
\n
It is the correct version. The counters are just not the same.
\nYou can verify by clicking the link of your submission in the My Submissions tab. It will link to the correct version (with a different number though).
@brandenkmurray I can confirm there is a bug as I submitted yesterday 38th version but it resulted in scoring 37th. And this morning I've just tried consciously - the same! I selected submit 39th and in a second I can see that it's evaluating 38th. That's a pitty having only 2 submissions a day!
", "votes": null, "replies": [ { "id": 1001278, "author_name": "cpmpml", "author_url": "", "post_date": "09/07/2020 07:43:49", "content": "I bet you have a failed sub with this noebook. It explains the differenc ein nu,bering, see other comments.
", "votes": null, "replies": [] }, { "id": 1001334, "author_name": "yaroshevskiy", "author_url": "", "post_date": "09/07/2020 08:47:01", "content": "I have 0 failed submissions I'm pretty sure about it :)
\nI would agree that's only numbering discrepancy but I've committed a kernel with a bug so got a low score (586) - I've fixed it and got the same score, I've changed architecture / checkpoint / thresholds - SAME. See the image:
\n
Looks like some linking problem too.
\nAgree with you and @hidehisaarai1213 that better to create a new notebook every time. Unfortunately
I'm not sure this is a good practice, but I always make a new notebook when I make a submission. In this way, at least we don't see such a problem. Hope this helps.
", "votes": null, "replies": [] }, { "id": 1002085, "author_name": "cv13j0", "author_url": "", "post_date": "09/07/2020 19:59:18", "content": "Hi! @brandenkmurray,
\nThe same here started happening 1.5 days ago. I notice that the submission vs my latest notebook is like 2 versions behind. at this point not sure if this is a UI error or actually is submitting older versions. before Saturday was perfect.