{
  "id": 263505,
  "title": "Kernel competitions and private test set",
  "url": "/competitions/siim-covid19-detection/discussion/263505",
  "author_name": "",
  "post_date": "2021-08-09T15:02:47.135154100Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi everyone!</p>\n<p>I understand that we will have to choose two of our submissions, and they are going to be processed by Kaggle (for computing the final LB score). This process will use the private test set, which was not used so far for the public LB scores.</p>\n<p>I guess that, during that final submission runs, the test set folder will be expanded to contain the private test set images.</p>\n<p>But I would like to know if the <code>sample_submission.csv</code> file from the official dataset will be updated accordingly, to contain the private images as well.</p>\n<p>If that is the case, we are correctly using this file for indexing the images that we need to process, but otherwise we would need to directly read all the images in the folder.</p>\n<p>I know that there is no much time in the competition but I would appreciate any insight on this!</p>\n<p>Kind regards,</p>",
  "messages": [
    {
      "id": "1461786",
      "postDate": "08/09/2021 15:02:47",
      "content": "<p>Hi everyone!</p>\n<p>I understand that we will have to choose two of our submissions, and they are going to be processed by Kaggle (for computing the final LB score). This process will use the private test set, which was not used so far for the public LB scores.</p>\n<p>I guess that, during that final submission runs, the test set folder will be expanded to contain the private test set images.</p>\n<p>But I would like to know if the <code>sample_submission.csv</code> file from the official dataset will be updated accordingly, to contain the private images as well.</p>\n<p>If that is the case, we are correctly using this file for indexing the images that we need to process, but otherwise we would need to directly read all the images in the folder.</p>\n<p>I know that there is no much time in the competition but I would appreciate any insight on this!</p>\n<p>Kind regards,</p>",
      "rawMarkdown": "Hi everyone!\n\nI understand that we will have to choose two of our submissions, and they are going to be processed by Kaggle (for computing the final LB score). This process will use the private test set, which was not used so far for the public LB scores.\n\nI guess that, during that final submission runs, the test set folder will be expanded to contain the private test set images.\n\nBut I would like to know if the `sample_submission.csv` file from the official dataset will be updated accordingly, to contain the private images as well.\n\nIf that is the case, we are correctly using this file for indexing the images that we need to process, but otherwise we would need to directly read all the images in the folder.\n\nI know that there is no much time in the competition but I would appreciate any insight on this!\n\nKind regards,",
      "votes": null
    },
    {
      "id": "1461789",
      "postDate": "08/09/2021 15:03:54",
      "content": "<p>If you submit the kernel, it is already working on the full test data (including private part).</p>",
      "rawMarkdown": "If you submit the kernel, it is already working on the full test data (including private part).",
      "votes": null
    },
    {
      "id": "1461830",
      "postDate": "08/09/2021 15:23:35",
      "content": "<p>Yes, sample_submission.csv and the test images are replaced when you submit your notebook.</p>\n<p>Your code is run on the full test set, but the public and private scores are calculated separately (in the same run).</p>",
      "rawMarkdown": "Yes, sample_submission.csv and the test images are replaced when you submit your notebook.\n\nYour code is run on the full test set, but the public and private scores are calculated separately (in the same run).",
      "votes": null
    },
    {
      "id": "1461851",
      "postDate": "08/09/2021 15:31:02",
      "content": "<p>Thank you!</p>",
      "rawMarkdown": "Thank you!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1461789,
      "author_name": "philippsinger",
      "author_url": "",
      "post_date": "08/09/2021 15:03:54",
      "content": "<p>If you submit the kernel, it is already working on the full test data (including private part).</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1461830,
      "author_name": "crodoc",
      "author_url": "",
      "post_date": "08/09/2021 15:23:35",
      "content": "<p>Yes, sample_submission.csv and the test images are replaced when you submit your notebook.</p>\n<p>Your code is run on the full test set, but the public and private scores are calculated separately (in the same run).</p>",
      "votes": null,
      "replies": [
        {
          "id": 1461851,
          "author_name": "federetyk",
          "author_url": "",
          "post_date": "08/09/2021 15:31:02",
          "content": "<p>Thank you!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1461786": "Hi everyone!\n\nI understand that we will have to choose two of our submissions, and they are going to be processed by Kaggle (for computing the final LB score). This process will use the private test set, which was not used so far for the public LB scores.\n\nI guess that, during that final submission runs, the test set folder will be expanded to contain the private test set images.\n\nBut I would like to know if the `sample_submission.csv` file from the official dataset will be updated accordingly, to contain the private images as well.\n\nIf that is the case, we are correctly using this file for indexing the images that we need to process, but otherwise we would need to directly read all the images in the folder.\n\nI know that there is no much time in the competition but I would appreciate any insight on this!\n\nKind regards,",
    "1461789": "If you submit the kernel, it is already working on the full test data (including private part).",
    "1461830": "Yes, sample_submission.csv and the test images are replaced when you submit your notebook.\n\nYour code is run on the full test set, but the public and private scores are calculated separately (in the same run).",
    "1461851": "Thank you!"
  },
  "source": "meta"
}