{
  "id": 262017,
  "title": "Test set clarification",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/262017",
  "author_name": "",
  "post_date": "2021-08-05T14:50:58.440002400Z",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p>The downloadable dataset includes a \"test\" folder, which matches the provided sample_submission.csv. </p>\n<p>It this the same test set used in the current LB submissions? </p>",
  "messages": [
    {
      "id": "1452227",
      "postDate": "08/05/2021 14:50:58",
      "content": "<p>The downloadable dataset includes a \"test\" folder, which matches the provided sample_submission.csv. </p>\n<p>It this the same test set used in the current LB submissions? </p>",
      "rawMarkdown": "The downloadable dataset includes a \"test\" folder, which matches the provided sample_submission.csv. \n\nIt this the same test set used in the current LB submissions?",
      "votes": null
    },
    {
      "id": "1452654",
      "postDate": "08/05/2021 16:57:33",
      "content": "<p>No. When you submit your notebook for scoring, a replacement \"test\" folder and \"sample_submission.csv\" file are referenced instead of the public test data.</p>",
      "rawMarkdown": "No. When you submit your notebook for scoring, a replacement \"test\" folder and \"sample_submission.csv\" file are referenced instead of the public test data.",
      "votes": null
    },
    {
      "id": "1452788",
      "postDate": "08/05/2021 17:30:14",
      "content": "<p>Thanks for the reply. So, what is the purpose of the \"test\" folder, if there is no label provided for it? (unless I'm missing something)</p>",
      "rawMarkdown": "Thanks for the reply. So, what is the purpose of the \"test\" folder, if there is no label provided for it? (unless I'm missing something)",
      "votes": null
    },
    {
      "id": "1452887",
      "postDate": "08/05/2021 17:58:45",
      "content": "<p>In this contest I think:</p>\n<p>The Public LB is based on the the Public Test data. This is based on a statement that the total test data is about 5x the public test data. This matches with the Public LB which is based on 22% of the full test data.</p>\n<p>So, I think you have access to the Public Test data which matches your Public LB score.</p>\n<p>The final score is based on the Private Test data, which you don't have access to.</p>\n<p>If you didn't have the test data, you wouldn't be able to make sure your algorithm runs correctly against a test data set. </p>\n<p>Some contests only give you a few Public test samples and the Public Leaderboard is based on a portion of the Private Test data.</p>\n<p>Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.</p>\n<p>-Rich</p>",
      "rawMarkdown": "In this contest I think:\n\nThe Public LB is based on the the Public Test data. This is based on a statement that the total test data is about 5x the public test data. This matches with the Public LB which is based on 22% of the full test data.\n\nSo, I think you have access to the Public Test data which matches your Public LB score.\n\nThe final score is based on the Private Test data, which you don't have access to.\n\nIf you didn't have the test data, you wouldn't be able to make sure your algorithm runs correctly against a test data set. \n\nSome contests only give you a few Public test samples and the Public Leaderboard is based on a portion of the Private Test data.\n\nNote that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.\n\n-Rich",
      "votes": null
    },
    {
      "id": "1453400",
      "postDate": "08/05/2021 21:00:10",
      "content": "<blockquote>\n  <p>Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.</p>\n</blockquote>\n<p>This is exactly what I was hoping to understand. Thanks a lot for the clarification! </p>",
      "rawMarkdown": "> Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.\n\nThis is exactly what I was hoping to understand. Thanks a lot for the clarification!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1452654,
      "author_name": "richardepstein",
      "author_url": "",
      "post_date": "08/05/2021 16:57:33",
      "content": "<p>No. When you submit your notebook for scoring, a replacement \"test\" folder and \"sample_submission.csv\" file are referenced instead of the public test data.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1452788,
          "author_name": "carloalbertobarbano",
          "author_url": "",
          "post_date": "08/05/2021 17:30:14",
          "content": "<p>Thanks for the reply. So, what is the purpose of the \"test\" folder, if there is no label provided for it? (unless I'm missing something)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1452887,
      "author_name": "richardepstein",
      "author_url": "",
      "post_date": "08/05/2021 17:58:45",
      "content": "<p>In this contest I think:</p>\n<p>The Public LB is based on the the Public Test data. This is based on a statement that the total test data is about 5x the public test data. This matches with the Public LB which is based on 22% of the full test data.</p>\n<p>So, I think you have access to the Public Test data which matches your Public LB score.</p>\n<p>The final score is based on the Private Test data, which you don't have access to.</p>\n<p>If you didn't have the test data, you wouldn't be able to make sure your algorithm runs correctly against a test data set. </p>\n<p>Some contests only give you a few Public test samples and the Public Leaderboard is based on a portion of the Private Test data.</p>\n<p>Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.</p>\n<p>-Rich</p>",
      "votes": null,
      "replies": [
        {
          "id": 1453400,
          "author_name": "carloalbertobarbano",
          "author_url": "",
          "post_date": "08/05/2021 21:00:10",
          "content": "<blockquote>\n  <p>Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.</p>\n</blockquote>\n<p>This is exactly what I was hoping to understand. Thanks a lot for the clarification! </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1452227": "The downloadable dataset includes a \"test\" folder, which matches the provided sample_submission.csv. \n\nIt this the same test set used in the current LB submissions?",
    "1452654": "No. When you submit your notebook for scoring, a replacement \"test\" folder and \"sample_submission.csv\" file are referenced instead of the public test data.",
    "1452788": "Thanks for the reply. So, what is the purpose of the \"test\" folder, if there is no label provided for it? (unless I'm missing something)",
    "1452887": "In this contest I think:\n\nThe Public LB is based on the the Public Test data. This is based on a statement that the total test data is about 5x the public test data. This matches with the Public LB which is based on 22% of the full test data.\n\nSo, I think you have access to the Public Test data which matches your Public LB score.\n\nThe final score is based on the Private Test data, which you don't have access to.\n\nIf you didn't have the test data, you wouldn't be able to make sure your algorithm runs correctly against a test data set. \n\nSome contests only give you a few Public test samples and the Public Leaderboard is based on a portion of the Private Test data.\n\nNote that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.\n\n-Rich",
    "1453400": "> Note that even though the Public Leaderboard is probably based on only the Public Test Data, your notebook submission probably needs to have an entry for all the Test data.\n\nThis is exactly what I was hoping to understand. Thanks a lot for the clarification!"
  },
  "source": "meta"
}