{
  "id": 338631,
  "title": "The date open the private test dataset and submission finally score",
  "url": "/competitions/hubmap-organ-segmentation/discussion/338631",
  "author_name": "",
  "post_date": "2022-07-21T08:35:13.425301700Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi everyone! this is my first time attend competition so I am wonder which time we can access the private test dataset and submission finally score, in the Overview page I saw the Rules Acceptance Deadline is Sep,16,2022,so I think the date(Sep,16) private test dataset will open and can submission finally score until Sep,23,2022,in this week, we can submission totally 35 times(7days*5submissions per day) right?<br>\nI am a foreign contestants, I hope my English doesn't affect your reading🙏</p>",
  "messages": [
    {
      "id": "1864666",
      "postDate": "07/21/2022 08:35:13",
      "content": "<p>Hi everyone! this is my first time attend competition so I am wonder which time we can access the private test dataset and submission finally score, in the Overview page I saw the Rules Acceptance Deadline is Sep,16,2022,so I think the date(Sep,16) private test dataset will open and can submission finally score until Sep,23,2022,in this week, we can submission totally 35 times(7days*5submissions per day) right?<br>\nI am a foreign contestants, I hope my English doesn't affect your reading🙏</p>",
      "rawMarkdown": "Hi everyone! this is my first time attend competition so I am wonder which time we can access the private test dataset and submission finally score, in the Overview page I saw the Rules Acceptance Deadline is Sep,16,2022,so I think the date(Sep,16) private test dataset will open and can submission finally score until Sep,23,2022,in this week, we can submission totally 35 times(7days*5submissions per day) right?\nI am a foreign contestants, I hope my English doesn't affect your reading🙏",
      "votes": null
    },
    {
      "id": "1864727",
      "postDate": "07/21/2022 09:08:06",
      "content": "<p>No sorry, we never have access to the private test dataset during the competition.</p>",
      "rawMarkdown": "No sorry, we never have access to the private test dataset during the competition.",
      "votes": null
    },
    {
      "id": "1864737",
      "postDate": "07/21/2022 09:21:46",
      "content": "<p>after you hit the submit button:</p>\n<ol>\n<li>you notebook is run on the server with a set of hidden test data.</li>\n<li>the hidden data is divided into 2 split: private and public</li>\n<li>the server then makes 2 score: private score and public score</li>\n<li>the leader board you see today and till the last day of the competition September 22, 2022 23:59 hrs is ranked based on the public score. It is called the public leaderboard.</li>\n<li>On September 23, 2022 00:00 hrs, a new leaderboard is created based on private score.</li>\n<li>prizes and medals are based on the new re-ranked  private leaderboard</li>\n</ol>\n<hr>\n<p>the objective of the competition is to get best ranking on the unknown private leaderboard.</p>\n<p>the public leaderboard today (and your local validation results, etc) is for you to estimate performance of the private one. </p>\n<hr>\n<p>sometimes people adjust threshold, model etc and get good results on public leaderboard but this can fail to get good results on the private one. This is called overfitting the public leaderboard, aka. shakeup</p>\n<hr>\n<p>in this competition in particular, there may be hidden winners till the last minute. people may want to save submission slots and submit only on the Hubmap dataset. hence they will not have high ranking on the public leaderboard. </p>",
      "rawMarkdown": "after you hit the submit button:\n1. you notebook is run on the server with a set of hidden test data.\n2. the hidden data is divided into 2 split: private and public\n3. the server then makes 2 score: private score and public score\n4. the leader board you see today and till the last day of the competition September 22, 2022 23:59 hrs is ranked based on the public score. It is called the public leaderboard.\n5. On September 23, 2022 00:00 hrs, a new leaderboard is created based on private score.\n6. prizes and medals are based on the new re-ranked  private leaderboard\n\n---\n\nthe objective of the competition is to get best ranking on the unknown private leaderboard.\n\nthe public leaderboard today (and your local validation results, etc) is for you to estimate performance of the private one. \n\n---\n\nsometimes people adjust threshold, model etc and get good results on public leaderboard but this can fail to get good results on the private one. This is called overfitting the public leaderboard, aka. shakeup\n\n---\n\nin this competition in particular, there may be hidden winners till the last minute. people may want to save submission slots and submit only on the Hubmap dataset. hence they will not have high ranking on the public leaderboard.",
      "votes": null
    },
    {
      "id": "1865670",
      "postDate": "07/22/2022 03:30:41",
      "content": "<p>thanks for your reply! i'm fully understand the rules of private score in this competition </p>",
      "rawMarkdown": "thanks for your reply! i'm fully understand the rules of private score in this competition",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1864727,
      "author_name": "maxvandijck",
      "author_url": "",
      "post_date": "07/21/2022 09:08:06",
      "content": "<p>No sorry, we never have access to the private test dataset during the competition.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1864737,
      "author_name": "hengck23",
      "author_url": "",
      "post_date": "07/21/2022 09:21:46",
      "content": "<p>after you hit the submit button:</p>\n<ol>\n<li>you notebook is run on the server with a set of hidden test data.</li>\n<li>the hidden data is divided into 2 split: private and public</li>\n<li>the server then makes 2 score: private score and public score</li>\n<li>the leader board you see today and till the last day of the competition September 22, 2022 23:59 hrs is ranked based on the public score. It is called the public leaderboard.</li>\n<li>On September 23, 2022 00:00 hrs, a new leaderboard is created based on private score.</li>\n<li>prizes and medals are based on the new re-ranked  private leaderboard</li>\n</ol>\n<hr>\n<p>the objective of the competition is to get best ranking on the unknown private leaderboard.</p>\n<p>the public leaderboard today (and your local validation results, etc) is for you to estimate performance of the private one. </p>\n<hr>\n<p>sometimes people adjust threshold, model etc and get good results on public leaderboard but this can fail to get good results on the private one. This is called overfitting the public leaderboard, aka. shakeup</p>\n<hr>\n<p>in this competition in particular, there may be hidden winners till the last minute. people may want to save submission slots and submit only on the Hubmap dataset. hence they will not have high ranking on the public leaderboard. </p>",
      "votes": null,
      "replies": [
        {
          "id": 1865670,
          "author_name": "sfgx8801234",
          "author_url": "",
          "post_date": "07/22/2022 03:30:41",
          "content": "<p>thanks for your reply! i'm fully understand the rules of private score in this competition </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1864666": "Hi everyone! this is my first time attend competition so I am wonder which time we can access the private test dataset and submission finally score, in the Overview page I saw the Rules Acceptance Deadline is Sep,16,2022,so I think the date(Sep,16) private test dataset will open and can submission finally score until Sep,23,2022,in this week, we can submission totally 35 times(7days*5submissions per day) right?\nI am a foreign contestants, I hope my English doesn't affect your reading🙏",
    "1864727": "No sorry, we never have access to the private test dataset during the competition.",
    "1864737": "after you hit the submit button:\n1. you notebook is run on the server with a set of hidden test data.\n2. the hidden data is divided into 2 split: private and public\n3. the server then makes 2 score: private score and public score\n4. the leader board you see today and till the last day of the competition September 22, 2022 23:59 hrs is ranked based on the public score. It is called the public leaderboard.\n5. On September 23, 2022 00:00 hrs, a new leaderboard is created based on private score.\n6. prizes and medals are based on the new re-ranked  private leaderboard\n\n---\n\nthe objective of the competition is to get best ranking on the unknown private leaderboard.\n\nthe public leaderboard today (and your local validation results, etc) is for you to estimate performance of the private one. \n\n---\n\nsometimes people adjust threshold, model etc and get good results on public leaderboard but this can fail to get good results on the private one. This is called overfitting the public leaderboard, aka. shakeup\n\n---\n\nin this competition in particular, there may be hidden winners till the last minute. people may want to save submission slots and submit only on the Hubmap dataset. hence they will not have high ranking on the public leaderboard.",
    "1865670": "thanks for your reply! i'm fully understand the rules of private score in this competition"
  },
  "source": "meta"
}