{
  "id": 305908,
  "title": "Public Test Set Labels",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/305908",
  "author_name": "Salvatore Capuozzo",
  "post_date": "2022-02-07T13:30:58.765000",
  "votes": 1,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Since I am working on competition data for academic research purposes, I would like to retrieve some analytical information from inference results on public test set (not the 22% for the public leaderboard, not even the one used for the private one, just the one composed by 87 patients).</p>\n<p>The private score is given by making predictions on a dataset composed of public data (test set of 87 patients) and some more private data, but since this last subset is not available, AUC values retrieved from Late Submissions cannot be used for my purposes.<br>\nI already tried to make a Hand-Labeled list of this test set, but since correctness of this list is not guaranteed, inference results cannot be based on it.</p>\n<p>For this reason, I would like to know if labels from the 87 test set patients are available somewhere or if someone who made LB Probing and retrieved 1.0 on Public Leaderboard can share the whole labels list or part of it.</p>\n<p>Thanks in advance.</p>",
  "messages": [
    {
      "id": 1679933,
      "postDate": "2022-02-07T13:30:58.767Z",
      "content": "<p>Since I am working on competition data for academic research purposes, I would like to retrieve some analytical information from inference results on public test set (not the 22% for the public leaderboard, not even the one used for the private one, just the one composed by 87 patients).</p>\n<p>The private score is given by making predictions on a dataset composed of public data (test set of 87 patients) and some more private data, but since this last subset is not available, AUC values retrieved from Late Submissions cannot be used for my purposes.<br>\nI already tried to make a Hand-Labeled list of this test set, but since correctness of this list is not guaranteed, inference results cannot be based on it.</p>\n<p>For this reason, I would like to know if labels from the 87 test set patients are available somewhere or if someone who made LB Probing and retrieved 1.0 on Public Leaderboard can share the whole labels list or part of it.</p>\n<p>Thanks in advance.</p>",
      "rawMarkdown": "Since I am working on competition data for academic research purposes, I would like to retrieve some analytical information from inference results on public test set (not the 22% for the public leaderboard, not even the one used for the private one, just the one composed by 87 patients).\n\nThe private score is given by making predictions on a dataset composed of public data (test set of 87 patients) and some more private data, but since this last subset is not available, AUC values retrieved from Late Submissions cannot be used for my purposes.\nI already tried to make a Hand-Labeled list of this test set, but since correctness of this list is not guaranteed, inference results cannot be based on it.\n\nFor this reason, I would like to know if labels from the 87 test set patients are available somewhere or if someone who made LB Probing and retrieved 1.0 on Public Leaderboard can share the whole labels list or part of it.\n\nThanks in advance.",
      "votes": 1
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1679933": "Since I am working on competition data for academic research purposes, I would like to retrieve some analytical information from inference results on public test set (not the 22% for the public leaderboard, not even the one used for the private one, just the one composed by 87 patients).\n\nThe private score is given by making predictions on a dataset composed of public data (test set of 87 patients) and some more private data, but since this last subset is not available, AUC values retrieved from Late Submissions cannot be used for my purposes.\nI already tried to make a Hand-Labeled list of this test set, but since correctness of this list is not guaranteed, inference results cannot be based on it.\n\nFor this reason, I would like to know if labels from the 87 test set patients are available somewhere or if someone who made LB Probing and retrieved 1.0 on Public Leaderboard can share the whole labels list or part of it.\n\nThanks in advance."
  }
}