Thanks all for your work on this competition! Just a reminder to select your final submissions for the private leaderboard prior to close.
\nNote: many teams have submissions that have a private score of 0. Make sure, when selecting your final submissions, that you do not select those!
Thanks all for your work on this competition! Just a reminder to select your final submissions for the private leaderboard prior to close.
\nNote: many teams have submissions that have a private score of 0. Make sure, when selecting your final submissions, that you do not select those!
I have a question on 0.000 scores. I cannot find any mechanism that skips private test set images. I am using example submission and fill the same file. Are you saying that example_submission doesn't include private tests? @cwinsnes
", "rawMarkdown": "I have a question on 0.000 scores. I cannot find any mechanism that skips private test set images. I am using example submission and fill the same file. Are you saying that example_submission doesn't include private tests? @cwinsnes ", "votes": 1, "replies": [ { "id": 1304773, "postDate": "2021-05-12T21:24:43.390Z", "content": "Your submission file that got selected for the leaderboard contains at least 1775 instances of the prediction 0 1 eNoLCAgIMAEABJkBdQ== which is the string that you can find in the sample_submission file. There are also several instances of the same prediction string but with floating point numbers close to 1 instead of the 1.
I don't know what may have happened to caused this, but from what I can see it seems that you have not made predictions on many of the images in the file.
", "rawMarkdown": "Your submission file that got selected for the leaderboard contains at least 1775 instances of the prediction `0 1 eNoLCAgIMAEABJkBdQ==` which is the string that you can find in the sample_submission file. There are also several instances of the same prediction string but with floating point numbers close to 1 instead of the `1`.\n\nI don't know what may have happened to caused this, but from what I can see it seems that you have not made predictions on many of the images in the file.", "votes": 2 }, { "id": 1306397, "postDate": "2021-05-13T18:28:14.553Z", "content": "Thank you for the help.
\nIt is very strange that the same code works for the public leaderboard. I hope it is not some wrong structure or code on your part.
", "rawMarkdown": "Thank you for the help.\n\nIt is very strange that the same code works for the public leaderboard. I hope it is not some wrong structure or code on your part.", "votes": 1 }, { "id": 1306439, "postDate": "2021-05-13T18:58:24.433Z", "content": "It may be the same thing that happened in Hubmap Comp. If you have a for loop that makes predictions on test data and adds the results to a Python list. Then in the next code cell you convert the Python list into a submission dataframe then CSV file.
\nThe for loop that makes predictions may successfully predict the public test and then make an error on the first private test. That code cell stops running and stops making predictions on private test. However, your code will continue running from the next code cell and successfully convert your partially filled Python list into a submission dataframe and CSV file
\nBut your CSV file has no predictions for private test.
", "rawMarkdown": "It may be the same thing that happened in Hubmap Comp. If you have a for loop that makes predictions on test data and adds the results to a Python list. Then in the next code cell you convert the Python list into a submission dataframe then CSV file.\n\nThe for loop that makes predictions may successfully predict the public test and then make an error on the first private test. That code cell stops running and stops making predictions on private test. However, your code will continue running from the next code cell and successfully convert your partially filled Python list into a submission dataframe and CSV file\n\nBut your CSV file has no predictions for private test.", "votes": 3 }, { "id": 1307071, "postDate": "2021-05-14T08:31:05.803Z", "content": "Thanks @cdeotte
\nThat's a good explanation. Unfortunately, I mostly focused on training the model and based my inference code on a public notebook. Lesson learned :)
", "rawMarkdown": "Thanks @cdeotte\n\n That's a good explanation. Unfortunately, I mostly focused on training the model and based my inference code on a public notebook. Lesson learned :)", "votes": 3 } ] }, { "id": 1303195, "postDate": "2021-05-12T00:36:19.600Z", "content": "why my private score is 0,but public score is 0.435.
", "rawMarkdown": "why my private score is 0,but public score is 0.435.", "votes": 2, "replies": [ { "id": 1303635, "postDate": "2021-05-12T06:57:43.277Z", "content": "I'm in a similar situation. Му LB score: 0.445, but private score is 0. I don't even understand why it happened that way.
", "rawMarkdown": "I'm in a similar situation. Му LB score: 0.445, but private score is 0. I don't even understand why it happened that way." }, { "id": 1303934, "postDate": "2021-05-12T10:48:13.133Z", "content": "@xuzongniubi After taking a quick look at your submission, it seems that you never made predictions for many images. You have the same prediction string for a lot of images (presumably corresponding to the private set) as the one being seen in the sample_submission file.
", "rawMarkdown": "@xuzongniubi After taking a quick look at your submission, it seems that you never made predictions for many images. You have the same prediction string for a lot of images (presumably corresponding to the private set) as the one being seen in the sample_submission file.", "votes": 1 } ] }, { "id": 1302842, "postDate": "2021-05-11T18:42:17.183Z", "content": "I resubmitted the code, but the code can't finish running before DDL. It seems that the code that doesn't finish running can't be selected. Is there a way to choose this submission? Thanks!
", "rawMarkdown": "I resubmitted the code, but the code can't finish running before DDL. It seems that the code that doesn't finish running can't be selected. Is there a way to choose this submission? Thanks!" }, { "id": 1302338, "postDate": "2021-05-11T13:56:05.370Z", "content": "First-time participant and noob here. Where do I find my private score? I see only public score and checkbox for final score. My notebook should work with a swapped dataset. Is there else something that I need to do?
\nI thought the private score would be revealed only after the end. Is it already calculated and just not revealed or how does it even work?
\nThanks
", "rawMarkdown": "First-time participant and noob here. Where do I find my private score? I see only public score and checkbox for final score. My notebook should work with a swapped dataset. Is there else something that I need to do?\n\nI thought the private score would be revealed only after the end. Is it already calculated and just not revealed or how does it even work?\n\nThanks", "replies": [ { "id": 1302447, "postDate": "2021-05-11T14:49:11.433Z", "content": "Your private score is hidden until the competition is done. We as hosts are however able to see that many submissions intentionally do not make predictions for the private set, so we are reminding you to not make those your chosen submissions for final scoring!
", "rawMarkdown": "Your private score is hidden until the competition is done. We as hosts are however able to see that many submissions intentionally do not make predictions for the private set, so we are reminding you to not make those your chosen submissions for final scoring!", "votes": 1 } ] }, { "id": 1301712, "postDate": "2021-05-11T07:54:42.433Z", "content": "Hi @philculliton :)
\nThank you for reminding us.
\nCan I tell from the CSV (submission.csv) file size if the code will work with the private leaderboard?
", "rawMarkdown": "Hi @philculliton :)\n\nThank you for reminding us. \n\nCan I tell from the CSV (submission.csv) file size if the code will work with the private leaderboard?\n" }, { "id": 1300845, "postDate": "2021-05-10T19:02:49.963Z", "content": "\n\nmany teams have submissions that do not have a private score. Make sure, when selecting your final submissions, that you do not select those!
\n
What does this mean? What determines whether a submission has a private score?
", "rawMarkdown": "> many teams have submissions that do not have a private score. Make sure, when selecting your final submissions, that you do not select those!\n\nWhat does this mean? What determines whether a submission has a private score?", "replies": [ { "id": 1300863, "postDate": "2021-05-10T19:21:50.033Z", "content": "@anokas If you make submissions that deliberately skip the private LB through some mechanism, then you probably have a private score of 0 on those submissions. If you're not deliberately skipping the private LB (i.e. if you are making predictions for all test samples) you should not have a problem.
Hi, thank you for the reminder!
\nI'm sorry for what could be a stupid question, just want to double check if my understanding is correct.
\nDo we have until tomorrow 11:59PM to submit? If so what is the deadline for our final selections?
You have to select a valid submission by 11:59PM, and some minutes later you will see the private scores
", "rawMarkdown": "You have to select a valid submission by 11:59PM, and some minutes later you will see the private scores", "votes": 1 } ] }, { "id": 1300667, "postDate": "2021-05-10T16:09:19.850Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 1304626, "author_name": "Eisa", "author_url": "", "post_date": "2021-05-12T18:37:46.967000", "content": "I have a question on 0.000 scores. I cannot find any mechanism that skips private test set images. I am using example submission and fill the same file. Are you saying that example_submission doesn't include private tests? @cwinsnes
", "votes": 1, "replies": [ { "id": 1304773, "author_name": "Casper Winsnes", "author_url": "", "post_date": "2021-05-12T21:24:43.390000", "content": "Your submission file that got selected for the leaderboard contains at least 1775 instances of the prediction 0 1 eNoLCAgIMAEABJkBdQ== which is the string that you can find in the sample_submission file. There are also several instances of the same prediction string but with floating point numbers close to 1 instead of the 1.
I don't know what may have happened to caused this, but from what I can see it seems that you have not made predictions on many of the images in the file.
", "votes": 2, "replies": [] }, { "id": 1306397, "author_name": "Eisa", "author_url": "", "post_date": "2021-05-13T18:28:14.553000", "content": "Thank you for the help.
\nIt is very strange that the same code works for the public leaderboard. I hope it is not some wrong structure or code on your part.
", "votes": 1, "replies": [] }, { "id": 1306439, "author_name": "Chris Deotte", "author_url": "", "post_date": "2021-05-13T18:58:24.433000", "content": "It may be the same thing that happened in Hubmap Comp. If you have a for loop that makes predictions on test data and adds the results to a Python list. Then in the next code cell you convert the Python list into a submission dataframe then CSV file.
\nThe for loop that makes predictions may successfully predict the public test and then make an error on the first private test. That code cell stops running and stops making predictions on private test. However, your code will continue running from the next code cell and successfully convert your partially filled Python list into a submission dataframe and CSV file
\nBut your CSV file has no predictions for private test.
", "votes": 3, "replies": [] }, { "id": 1307071, "author_name": "Eisa", "author_url": "", "post_date": "2021-05-14T08:31:05.803000", "content": "Thanks @cdeotte
\nThat's a good explanation. Unfortunately, I mostly focused on training the model and based my inference code on a public notebook. Lesson learned :)
", "votes": 3, "replies": [] } ] }, { "id": 1303195, "author_name": "superbee", "author_url": "", "post_date": "2021-05-12T00:36:19.600000", "content": "why my private score is 0,but public score is 0.435.
", "votes": 2, "replies": [ { "id": 1303635, "author_name": "Greg816", "author_url": "", "post_date": "2021-05-12T06:57:43.277000", "content": "I'm in a similar situation. Му LB score: 0.445, but private score is 0. I don't even understand why it happened that way.
", "votes": 0, "replies": [] }, { "id": 1303934, "author_name": "Casper Winsnes", "author_url": "", "post_date": "2021-05-12T10:48:13.133000", "content": "@xuzongniubi After taking a quick look at your submission, it seems that you never made predictions for many images. You have the same prediction string for a lot of images (presumably corresponding to the private set) as the one being seen in the sample_submission file.
", "votes": 1, "replies": [] } ] }, { "id": 1302842, "author_name": "AndrewTal", "author_url": "", "post_date": "2021-05-11T18:42:17.183000", "content": "I resubmitted the code, but the code can't finish running before DDL. It seems that the code that doesn't finish running can't be selected. Is there a way to choose this submission? Thanks!
", "votes": 0, "replies": [] }, { "id": 1302338, "author_name": "jrrr259", "author_url": "", "post_date": "2021-05-11T13:56:05.370000", "content": "First-time participant and noob here. Where do I find my private score? I see only public score and checkbox for final score. My notebook should work with a swapped dataset. Is there else something that I need to do?
\nI thought the private score would be revealed only after the end. Is it already calculated and just not revealed or how does it even work?
\nThanks
", "votes": 0, "replies": [ { "id": 1302447, "author_name": "Casper Winsnes", "author_url": "", "post_date": "2021-05-11T14:49:11.433000", "content": "Your private score is hidden until the competition is done. We as hosts are however able to see that many submissions intentionally do not make predictions for the private set, so we are reminding you to not make those your chosen submissions for final scoring!
", "votes": 1, "replies": [] } ] }, { "id": 1301712, "author_name": "Faisal Alsrheed", "author_url": "", "post_date": "2021-05-11T07:54:42.433000", "content": "Hi @philculliton :)
\nThank you for reminding us.
\nCan I tell from the CSV (submission.csv) file size if the code will work with the private leaderboard?
", "votes": 0, "replies": [] }, { "id": 1300845, "author_name": "anokas", "author_url": "", "post_date": "2021-05-10T19:02:49.963000", "content": "\n\nmany teams have submissions that do not have a private score. Make sure, when selecting your final submissions, that you do not select those!
\n
What does this mean? What determines whether a submission has a private score?
", "votes": 0, "replies": [ { "id": 1300863, "author_name": "Phil Culliton", "author_url": "", "post_date": "2021-05-10T19:21:50.033000", "content": "@anokas If you make submissions that deliberately skip the private LB through some mechanism, then you probably have a private score of 0 on those submissions. If you're not deliberately skipping the private LB (i.e. if you are making predictions for all test samples) you should not have a problem.
Hi, thank you for the reminder!
\nI'm sorry for what could be a stupid question, just want to double check if my understanding is correct.
\nDo we have until tomorrow 11:59PM to submit? If so what is the deadline for our final selections?
You have to select a valid submission by 11:59PM, and some minutes later you will see the private scores
", "votes": 1, "replies": [] } ] }, { "id": 1300667, "author_name": "", "author_url": "", "post_date": "2021-05-10T16:09:19.850000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "1300655": "Thanks all for your work on this competition! Just a reminder to select your final submissions for the private leaderboard prior to close.\n\nNote: many teams have submissions that have a private score of `0`. **Make sure, when selecting your final submissions, that you do not select those!**", "1304626": "I have a question on 0.000 scores. I cannot find any mechanism that skips private test set images. I am using example submission and fill the same file. Are you saying that example_submission doesn't include private tests? @cwinsnes ", "1303195": "why my private score is 0,but public score is 0.435.", "1302842": "I resubmitted the code, but the code can't finish running before DDL. It seems that the code that doesn't finish running can't be selected. Is there a way to choose this submission? Thanks!", "1302338": "First-time participant and noob here. Where do I find my private score? I see only public score and checkbox for final score. My notebook should work with a swapped dataset. Is there else something that I need to do?\n\nI thought the private score would be revealed only after the end. Is it already calculated and just not revealed or how does it even work?\n\nThanks", "1301712": "Hi @philculliton :)\n\nThank you for reminding us. \n\nCan I tell from the CSV (submission.csv) file size if the code will work with the private leaderboard?\n", "1300845": "> many teams have submissions that do not have a private score. Make sure, when selecting your final submissions, that you do not select those!\n\nWhat does this mean? What determines whether a submission has a private score?", "1300709": "Hi, thank you for the reminder! \nI'm sorry for what could be a stupid question, just want to double check if my understanding is correct. \nDo we have until tomorrow 11:59PM to submit? If so what is the deadline for our final selections?", "1300667": "" } }