First of all, congratulations to all the winners, and thanks so much for share your approaches and solutions.
\nI have a doubt, during the competition period I reached public scores in the range of 0.610 to 0.612, but today the private scores of all my submissions have dropped to a score of 0.093.
\nDo anybody know why this has could happend? I am a little frustrated…
Thanks in advance, and congratulations again to all the winners!
", "messages": [ { "id": "1463640", "postDate": "08/10/2021 09:11:18", "content": "First of all, congratulations to all the winners, and thanks so much for share your approaches and solutions.
\nI have a doubt, during the competition period I reached public scores in the range of 0.610 to 0.612, but today the private scores of all my submissions have dropped to a score of 0.093.
\nDo anybody know why this has could happend? I am a little frustrated…
Thanks in advance, and congratulations again to all the winners!
", "rawMarkdown": "First of all, congratulations to all the winners, and thanks so much for share your approaches and solutions.\n\nI have a doubt, during the competition period I reached **public scores** in the range of **0.610 to 0.612**, but today the **private scores** of all my submissions have dropped to a score of **0.093**. \nDo anybody know why this has could happend? I am a little frustrated…\n\n\nThanks in advance, and congratulations again to all the winners!", "votes": null }, { "id": "1463989", "postDate": "08/10/2021 12:10:20", "content": "Did you use another dataset as test data?
", "rawMarkdown": "Did you use another dataset as test data?", "votes": null }, { "id": "1464226", "postDate": "08/10/2021 13:50:43", "content": "No, I used the same test dataset. All my submission files have two scores: the public ones, from 0.610 to 0.612 and the private ones: 0.093 for all of them. I expected some drop in the private scores, but from 0.610-0.612 to 0.093 in all the submission files is a bit strange.
", "rawMarkdown": "No, I used the same test dataset. All my submission files have two scores: the public ones, from 0.610 to 0.612 and the private ones: 0.093 for all of them. I expected some drop in the private scores, but from 0.610-0.612 to 0.093 in all the submission files is a bit strange.", "votes": null }, { "id": "1464238", "postDate": "08/10/2021 13:54:29", "content": "My submissions: ![https://drive.google.com/file/d/16dNxRw9LWCcTyG05s2gbqheucvHdYUch/view?usp=sharing]
", "rawMarkdown": "My submissions: ![https://drive.google.com/file/d/16dNxRw9LWCcTyG05s2gbqheucvHdYUch/view?usp=sharing]", "votes": null }, { "id": "1464271", "postDate": "08/10/2021 14:12:21", "content": "Hi @javierreinoso, when I clicked your drive link, it says \"Access Denied\"
\nYou may first change the drive permission to \"Anyone with the link may view\"
\nThanks!
it is because you only predict on public test dataset. All your private prediction are zeros.
", "rawMarkdown": "it is because you only predict on public test dataset. All your private prediction are zeros.", "votes": null }, { "id": "1464329", "postDate": "08/10/2021 14:34:56", "content": "I did it. Can you see the screenshot now? thanks!!!
", "rawMarkdown": "I did it. Can you see the screenshot now? thanks!!!", "votes": null }, { "id": "1464368", "postDate": "08/10/2021 14:46:59", "content": "Thanks for your answer. You are right. My notebook didn't consider private data. :(
", "rawMarkdown": "Thanks for your answer. You are right. My notebook didn't consider private data. :(", "votes": null }, { "id": "1464375", "postDate": "08/10/2021 14:48:17", "content": "Yes. thank you. I agree with @nvnnghia. It seems like you only did the inference on the public test dataset. If you can share one of your notebooks then we can better verify this.
", "rawMarkdown": "Yes. thank you. I agree with @nvnnghia. It seems like you only did the inference on the public test dataset. If you can share one of your notebooks then we can better verify this.", "votes": null }, { "id": "1464394", "postDate": "08/10/2021 14:54:58", "content": "Thanks for your answer Jonathan.
", "rawMarkdown": "Thanks for your answer Jonathan.", "votes": null } ], "comments": [ { "id": 1463989, "author_name": "chihantsai", "author_url": "", "post_date": "08/10/2021 12:10:20", "content": "Did you use another dataset as test data?
", "votes": null, "replies": [ { "id": 1464226, "author_name": "javierreinoso", "author_url": "", "post_date": "08/10/2021 13:50:43", "content": "No, I used the same test dataset. All my submission files have two scores: the public ones, from 0.610 to 0.612 and the private ones: 0.093 for all of them. I expected some drop in the private scores, but from 0.610-0.612 to 0.093 in all the submission files is a bit strange.
", "votes": null, "replies": [] } ] }, { "id": 1464238, "author_name": "javierreinoso", "author_url": "", "post_date": "08/10/2021 13:54:29", "content": "My submissions: ![https://drive.google.com/file/d/16dNxRw9LWCcTyG05s2gbqheucvHdYUch/view?usp=sharing]
", "votes": null, "replies": [ { "id": 1464271, "author_name": "rickandjoe", "author_url": "", "post_date": "08/10/2021 14:12:21", "content": "Hi @javierreinoso, when I clicked your drive link, it says \"Access Denied\"
\nYou may first change the drive permission to \"Anyone with the link may view\"
\nThanks!
I did it. Can you see the screenshot now? thanks!!!
", "votes": null, "replies": [] } ] }, { "id": 1464375, "author_name": "rickandjoe", "author_url": "", "post_date": "08/10/2021 14:48:17", "content": "Yes. thank you. I agree with @nvnnghia. It seems like you only did the inference on the public test dataset. If you can share one of your notebooks then we can better verify this.
", "votes": null, "replies": [] }, { "id": 1464394, "author_name": "javierreinoso", "author_url": "", "post_date": "08/10/2021 14:54:58", "content": "Thanks for your answer Jonathan.
", "votes": null, "replies": [] } ] }, { "id": 1464308, "author_name": "nvnnghia", "author_url": "", "post_date": "08/10/2021 14:26:00", "content": "it is because you only predict on public test dataset. All your private prediction are zeros.
", "votes": null, "replies": [ { "id": 1464368, "author_name": "javierreinoso", "author_url": "", "post_date": "08/10/2021 14:46:59", "content": "Thanks for your answer. You are right. My notebook didn't consider private data. :(
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "1463640": "First of all, congratulations to all the winners, and thanks so much for share your approaches and solutions.\n\nI have a doubt, during the competition period I reached **public scores** in the range of **0.610 to 0.612**, but today the **private scores** of all my submissions have dropped to a score of **0.093**. \nDo anybody know why this has could happend? I am a little frustrated…\n\n\nThanks in advance, and congratulations again to all the winners!", "1463989": "Did you use another dataset as test data?", "1464226": "No, I used the same test dataset. All my submission files have two scores: the public ones, from 0.610 to 0.612 and the private ones: 0.093 for all of them. I expected some drop in the private scores, but from 0.610-0.612 to 0.093 in all the submission files is a bit strange.", "1464238": "My submissions: ![https://drive.google.com/file/d/16dNxRw9LWCcTyG05s2gbqheucvHdYUch/view?usp=sharing]", "1464271": "Hi @javierreinoso, when I clicked your drive link, it says \"Access Denied\"\nYou may first change the drive permission to \"Anyone with the link may view\"\nThanks!", "1464308": "it is because you only predict on public test dataset. All your private prediction are zeros.", "1464329": "I did it. Can you see the screenshot now? thanks!!!", "1464368": "Thanks for your answer. You are right. My notebook didn't consider private data. :(", "1464375": "Yes. thank you. I agree with @nvnnghia. It seems like you only did the inference on the public test dataset. If you can share one of your notebooks then we can better verify this.", "1464394": "Thanks for your answer Jonathan." }, "source": "meta" }