Just a basic question around how Kaggle system work. Can host and Kaggle staff see private score in real time or they have to wait until the competition end?
\nAdditional question: can they change the test dataset anytime before the competition end or it's already settled?
", "messages": [ { "id": 2825253, "postDate": "2024-05-20T08:42:49.827Z", "content": "Hi @shyhandsome,
\n1) we can see private leaderboard. I don't think it's real time, I suspect there is small delay between public and private…
\n2) we can't change test dataset. It would require restart of competition and deletion of all submission. So if you are asking whether we can \"play\" structure of private leaderboard during the competition, we can't…
So you don't change the metrics because you can see that hackers don't work on private leaderboard，Is this it？😂
", "rawMarkdown": "So you don't change the metrics because you can see that hackers don't work on private leaderboard，Is this it？😂", "votes": 1 } ] }, { "id": 2822652, "postDate": "2024-05-18T17:34:59.430Z", "content": "Just a basic question around how Kaggle system work. Can host and Kaggle staff see private score in real time or they have to wait until the competition end?
\nAdditional question: can they change the test dataset anytime before the competition end or it's already settled?
", "rawMarkdown": "Just a basic question around how Kaggle system work. Can host and Kaggle staff see private score in real time or they have to wait until the competition end?\n\nAdditional question: can they change the test dataset anytime before the competition end or it's already settled?\n\n", "votes": 2 }, { "id": 2822654, "postDate": "2024-05-18T17:36:17.730Z", "rawMarkdown": "", "votes": -2, "isDeleted": true, "replies": [ { "id": 2822661, "postDate": "2024-05-18T17:43:47.623Z", "content": "Thank you! Do you happen to know what is the competition people mentioned that has huge shakeup happened where host select a very specific range of test dataset? the one like 1000th+ team end up in gold.
", "rawMarkdown": "Thank you! Do you happen to know what is the competition people mentioned that has huge shakeup happened where host select a very specific range of test dataset? the one like 1000th+ team end up in gold. ", "replies": [ { "id": 2822719, "postDate": "2024-05-18T18:14:40.727Z", "content": "ICR: https://www.kaggle.com/competitions/icr-identify-age-related-conditions.
", "rawMarkdown": "ICR: https://www.kaggle.com/competitions/icr-identify-age-related-conditions.", "votes": 1 }, { "id": 2822793, "postDate": "2024-05-18T19:00:32.463Z", "rawMarkdown": "", "votes": -1, "isDeleted": true }, { "id": 2823538, "postDate": "2024-05-19T09:22:22.477Z", "content": "In that ICR competition I was positively shocked to go up for about 3000 places in private leaderboard, but for sure it's not normal when public LB is far from the private, it should let people see their approximate position and not +/-3000 between 6500 participants.
", "rawMarkdown": "In that ICR competition I was positively shocked to go up for about 3000 places in private leaderboard, but for sure it's not normal when public LB is far from the private, it should let people see their approximate position and not +/-3000 between 6500 participants." } ] } ] } ], "comments": [ { "id": 2825253, "author_name": "Tomas Jelinek", "author_url": "", "post_date": "2024-05-20T08:42:49.827000", "content": "Hi @shyhandsome,
\n1) we can see private leaderboard. I don't think it's real time, I suspect there is small delay between public and private…
\n2) we can't change test dataset. It would require restart of competition and deletion of all submission. So if you are asking whether we can \"play\" structure of private leaderboard during the competition, we can't…
So you don't change the metrics because you can see that hackers don't work on private leaderboard，Is this it？😂
", "votes": 1, "replies": [] } ] }, { "id": 2822654, "author_name": "", "author_url": "", "post_date": "2024-05-18T17:36:17.730000", "content": "", "votes": -2, "replies": [ { "id": 2822661, "author_name": "hongyi shui", "author_url": "", "post_date": "2024-05-18T17:43:47.623000", "content": "Thank you! Do you happen to know what is the competition people mentioned that has huge shakeup happened where host select a very specific range of test dataset? the one like 1000th+ team end up in gold.
", "votes": 0, "replies": [ { "id": 2822719, "author_name": "ejwlk", "author_url": "", "post_date": "2024-05-18T18:14:40.727000", "content": "ICR: https://www.kaggle.com/competitions/icr-identify-age-related-conditions.
", "votes": 1, "replies": [] }, { "id": 2822793, "author_name": "", "author_url": "", "post_date": "2024-05-18T19:00:32.463000", "content": "", "votes": -1, "replies": [] }, { "id": 2823538, "author_name": "Danu A.", "author_url": "", "post_date": "2024-05-19T09:22:22.477000", "content": "In that ICR competition I was positively shocked to go up for about 3000 places in private leaderboard, but for sure it's not normal when public LB is far from the private, it should let people see their approximate position and not +/-3000 between 6500 participants.
", "votes": 0, "replies": [] } ] } ] } ], "raw_markdown_by_id": { "2825253": "Hi @shyhandsome,\n\n1) we can see private leaderboard. I don't think it's real time, I suspect there is small delay between public and private...\n2) we can't change test dataset. It would require restart of competition and deletion of all submission. So if you are asking whether we can \"play\" structure of private leaderboard during the competition, we can't...", "2822652": "Just a basic question around how Kaggle system work. Can host and Kaggle staff see private score in real time or they have to wait until the competition end?\n\nAdditional question: can they change the test dataset anytime before the competition end or it's already settled?\n\n", "2822654": "" } }