{
  "id": 167986,
  "title": "LB for 30% of data?",
  "url": "/competitions/siim-isic-melanoma-classification/discussion/167986",
  "author_name": "",
  "post_date": "2020-07-18T16:13:14.856224400Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>what this mean:\"This leaderboard is calculated with approximately 30% of the test data.</p>\n\n<p>The final results will be based on the other 70%, so the final standings may be different.\"?</p>",
  "messages": [
    {
      "id": "934670",
      "postDate": "07/18/2020 16:13:14",
      "content": "<p>what this mean:\"This leaderboard is calculated with approximately 30% of the test data.</p>\n\n<p>The final results will be based on the other 70%, so the final standings may be different.\"?</p>",
      "rawMarkdown": "what this mean:\"This leaderboard is calculated with approximately 30% of the test data.\n\nThe final results will be based on the other 70%, so the final standings may be different.\"?",
      "votes": null
    },
    {
      "id": "934699",
      "postDate": "07/18/2020 16:50:06",
      "content": "<p>You are correct. This is how many Kaggle contests work. To prevent you from simply overfitting the leaderboard, you don't actually see your score on the real (\"private\") leaderboard until the end of the contest. You need to use your \"public\" leaderboard score and your own \"cross-validation\" on the provided training data to determine which of your models you have the most confidence in.</p>\n\n<p>Changes in score between \"public\" and \"private\" leaderboard is called \"shakeup\" and can sometimes be very dramatic.</p>\n\n<p>-Rich</p>",
      "rawMarkdown": "You are correct. This is how many Kaggle contests work. To prevent you from simply overfitting the leaderboard, you don't actually see your score on the real (\"private\") leaderboard until the end of the contest. You need to use your \"public\" leaderboard score and your own \"cross-validation\" on the provided training data to determine which of your models you have the most confidence in.\n\nChanges in score between \"public\" and \"private\" leaderboard is called \"shakeup\" and can sometimes be very dramatic.\n\n-Rich",
      "votes": null
    },
    {
      "id": "934904",
      "postDate": "07/18/2020 22:15:11",
      "content": "<p>Thanks</p>",
      "rawMarkdown": "Thanks",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 934699,
      "author_name": "richardepstein",
      "author_url": "",
      "post_date": "07/18/2020 16:50:06",
      "content": "<p>You are correct. This is how many Kaggle contests work. To prevent you from simply overfitting the leaderboard, you don't actually see your score on the real (\"private\") leaderboard until the end of the contest. You need to use your \"public\" leaderboard score and your own \"cross-validation\" on the provided training data to determine which of your models you have the most confidence in.</p>\n\n<p>Changes in score between \"public\" and \"private\" leaderboard is called \"shakeup\" and can sometimes be very dramatic.</p>\n\n<p>-Rich</p>",
      "votes": null,
      "replies": [
        {
          "id": 934904,
          "author_name": "serg132003",
          "author_url": "",
          "post_date": "07/18/2020 22:15:11",
          "content": "<p>Thanks</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "934670": "what this mean:\"This leaderboard is calculated with approximately 30% of the test data.\n\nThe final results will be based on the other 70%, so the final standings may be different.\"?",
    "934699": "You are correct. This is how many Kaggle contests work. To prevent you from simply overfitting the leaderboard, you don't actually see your score on the real (\"private\") leaderboard until the end of the contest. You need to use your \"public\" leaderboard score and your own \"cross-validation\" on the provided training data to determine which of your models you have the most confidence in.\n\nChanges in score between \"public\" and \"private\" leaderboard is called \"shakeup\" and can sometimes be very dramatic.\n\n-Rich",
    "934904": "Thanks"
  },
  "source": "meta"
}