{
  "id": 469245,
  "title": "Will private LB include 100% of test data or 65%?",
  "url": "/competitions/hms-harmful-brain-activity-classification/discussion/469245",
  "author_name": "",
  "post_date": "2024-01-19T17:05:50.110833300Z",
  "votes": 3,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I'm curious if 100% of the test data will be used to calculate the final results. Based on the LB description, it would seem 35% of the test data will NOT be used in the final results:</p>\n<blockquote>\n  <p>This leaderboard is calculated with approximately 35% of the test data. The final results will be based on the other 65%, so the final standings may be different.</p>\n</blockquote>\n<p>Can anyone clarify? Have past competitions used mutually exclusive test data for public and private scores? I assumed the private scores were always calculated using 100% of the test data.</p>",
  "messages": [
    {
      "id": "2609734",
      "postDate": "01/19/2024 17:05:50",
      "content": "<p>I'm curious if 100% of the test data will be used to calculate the final results. Based on the LB description, it would seem 35% of the test data will NOT be used in the final results:</p>\n<blockquote>\n  <p>This leaderboard is calculated with approximately 35% of the test data. The final results will be based on the other 65%, so the final standings may be different.</p>\n</blockquote>\n<p>Can anyone clarify? Have past competitions used mutually exclusive test data for public and private scores? I assumed the private scores were always calculated using 100% of the test data.</p>",
      "rawMarkdown": "I'm curious if 100% of the test data will be used to calculate the final results. Based on the LB description, it would seem 35% of the test data will NOT be used in the final results:\n\n>This leaderboard is calculated with approximately 35% of the test data. The final results will be based on the other 65%, so the final standings may be different.\n\nCan anyone clarify? Have past competitions used mutually exclusive test data for public and private scores? I assumed the private scores were always calculated using 100% of the test data.",
      "votes": null
    },
    {
      "id": "2609776",
      "postDate": "01/19/2024 17:26:56",
      "content": "<p>They are mutually exclusive. Private will be 65% of test.</p>",
      "rawMarkdown": "They are mutually exclusive. Private will be 65% of test.",
      "votes": null
    },
    {
      "id": "2609878",
      "postDate": "01/19/2024 18:40:51",
      "content": "<p>65% of the overall test data will be in the private LB <a href=\"https://www.kaggle.com/seanbearden\" target=\"_blank\">@seanbearden</a> </p>",
      "rawMarkdown": "65% of the overall test data will be in the private LB @seanbearden",
      "votes": null
    },
    {
      "id": "2609939",
      "postDate": "01/19/2024 19:25:42",
      "content": "<p>Private test is almost always mutually exclusive from public test, to prevent overfitting the LB.</p>",
      "rawMarkdown": "Private test is almost always mutually exclusive from public test, to prevent overfitting the LB.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2609776,
      "author_name": "cdeotte",
      "author_url": "",
      "post_date": "01/19/2024 17:26:56",
      "content": "<p>They are mutually exclusive. Private will be 65% of test.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2609878,
      "author_name": "ravi20076",
      "author_url": "",
      "post_date": "01/19/2024 18:40:51",
      "content": "<p>65% of the overall test data will be in the private LB <a href=\"https://www.kaggle.com/seanbearden\" target=\"_blank\">@seanbearden</a> </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2609939,
      "author_name": "shlomoron",
      "author_url": "",
      "post_date": "01/19/2024 19:25:42",
      "content": "<p>Private test is almost always mutually exclusive from public test, to prevent overfitting the LB.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2609734": "I'm curious if 100% of the test data will be used to calculate the final results. Based on the LB description, it would seem 35% of the test data will NOT be used in the final results:\n\n>This leaderboard is calculated with approximately 35% of the test data. The final results will be based on the other 65%, so the final standings may be different.\n\nCan anyone clarify? Have past competitions used mutually exclusive test data for public and private scores? I assumed the private scores were always calculated using 100% of the test data.",
    "2609776": "They are mutually exclusive. Private will be 65% of test.",
    "2609878": "65% of the overall test data will be in the private LB @seanbearden",
    "2609939": "Private test is almost always mutually exclusive from public test, to prevent overfitting the LB."
  },
  "source": "meta"
}