{
  "id": 279774,
  "title": "- 1 score in private?",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/279774",
  "author_name": "Krish Yadav",
  "post_date": "2021-10-19T02:15:47.449000",
  "votes": 7,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hey guys many of our submissions have -1.00000 in PLB, how can that be possible?</p>\n<p>Are only the 2 files chosen for submissions checked?</p>",
  "messages": [
    {
      "id": 1549498,
      "postDate": "2021-10-19T02:15:47.450Z",
      "content": "<p>Hey guys many of our submissions have -1.00000 in PLB, how can that be possible?</p>\n<p>Are only the 2 files chosen for submissions checked?</p>",
      "rawMarkdown": "Hey guys many of our submissions have -1.00000 in PLB, how can that be possible?\n\nAre only the 2 files chosen for submissions checked?\n",
      "votes": 7
    },
    {
      "id": 1549614,
      "postDate": "2021-10-19T05:06:13.493Z",
      "content": "<p>I assume that <code>-1</code> means Kaggle didn't compute (i.e. will not reveal) the private score. Kaggle said <a href=\"https://www.kaggle.com/c/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278921\" target=\"_blank\">here</a> that they were not going to compute all the private scores.</p>",
      "rawMarkdown": "I assume that `-1` means Kaggle didn't compute (i.e. will not reveal) the private score. Kaggle said [here][1] that they were not going to compute all the private scores.\n\n[1]: https://www.kaggle.com/c/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278921",
      "votes": 4,
      "replies": [
        {
          "id": 1549881,
          "postDate": "2021-10-19T08:59:38.480Z",
          "content": "<p>So, if they didn't score all of our submissions then how are we going to evaluate our different approaches? And learn the best approaches to use in future competitions…</p>",
          "rawMarkdown": "So, if they didn't score all of our submissions then how are we going to evaluate our different approaches? And learn the best approaches to use in future competitions...",
          "votes": 2
        },
        {
          "id": 1549915,
          "postDate": "2021-10-19T09:28:14.750Z",
          "content": "<p>You are right, it's a shame they didn't reveal private score of other submissions. Now I have to resubmit old submissions to check if any of my approaches worked…</p>",
          "rawMarkdown": "You are right, it's a shame they didn't reveal private score of other submissions. Now I have to resubmit old submissions to check if any of my approaches worked...",
          "votes": 1
        },
        {
          "id": 1550056,
          "postDate": "2021-10-19T12:03:05.650Z",
          "content": "<p>I don't think it's a shame, see there are tens of thousands of submissions, if Kaggle ran each of them, then it would have taken at least a month or two running it, plus more pressure on GPUs and TPU's apart from CPU's.</p>\n<p>Also if I am right then submitting now will only be evaluated in the public leaderboard and not private ones, so maybe we can test on private database</p>",
          "rawMarkdown": "I don't think it's a shame, see there are tens of thousands of submissions, if Kaggle ran each of them, then it would have taken at least a month or two running it, plus more pressure on GPUs and TPU's apart from CPU's.\n\nAlso if I am right then submitting now will only be evaluated in the public leaderboard and not private ones, so maybe we can test on private database"
        },
        {
          "id": 1550105,
          "postDate": "2021-10-19T12:57:56.420Z",
          "content": "<p>Yeah full agreement with your quotes as I and the topic author has tried different approaches and we are not getting which approach was the best for us</p>",
          "rawMarkdown": "Yeah full agreement with your quotes as I and the topic author has tried different approaches and we are not getting which approach was the best for us"
        }
      ]
    },
    {
      "id": 1550208,
      "postDate": "2021-10-19T14:15:51.950Z",
      "content": "<p>The reason was to ensure the labels of the Private test set were not able to be probed after the competition.</p>",
      "rawMarkdown": "The reason was to ensure the labels of the Private test set were not able to be probed after the competition.",
      "replies": [
        {
          "id": 1550442,
          "postDate": "2021-10-19T18:18:01.513Z",
          "content": "<p>Ok thanks, but we wanted to know if the Max_trials parameter had any effect in PLB, so is there any way to do it?</p>",
          "rawMarkdown": "Ok thanks, but we wanted to know if the Max_trials parameter had any effect in PLB, so is there any way to do it?"
        }
      ]
    },
    {
      "id": 1549526,
      "postDate": "2021-10-19T03:02:46.820Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1549614,
      "author_name": "Chris Deotte",
      "author_url": "",
      "post_date": "2021-10-19T05:06:13.493000",
      "content": "<p>I assume that <code>-1</code> means Kaggle didn't compute (i.e. will not reveal) the private score. Kaggle said <a href=\"https://www.kaggle.com/c/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278921\" target=\"_blank\">here</a> that they were not going to compute all the private scores.</p>",
      "votes": 4,
      "replies": [
        {
          "id": 1549881,
          "author_name": "Susnato Dhar",
          "author_url": "",
          "post_date": "2021-10-19T08:59:38.480000",
          "content": "<p>So, if they didn't score all of our submissions then how are we going to evaluate our different approaches? And learn the best approaches to use in future competitions…</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1549915,
          "author_name": "NaN",
          "author_url": "",
          "post_date": "2021-10-19T09:28:14.750000",
          "content": "<p>You are right, it's a shame they didn't reveal private score of other submissions. Now I have to resubmit old submissions to check if any of my approaches worked…</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1550056,
          "author_name": "Krish Yadav",
          "author_url": "",
          "post_date": "2021-10-19T12:03:05.650000",
          "content": "<p>I don't think it's a shame, see there are tens of thousands of submissions, if Kaggle ran each of them, then it would have taken at least a month or two running it, plus more pressure on GPUs and TPU's apart from CPU's.</p>\n<p>Also if I am right then submitting now will only be evaluated in the public leaderboard and not private ones, so maybe we can test on private database</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1550105,
          "author_name": "Aditya Sharma",
          "author_url": "",
          "post_date": "2021-10-19T12:57:56.420000",
          "content": "<p>Yeah full agreement with your quotes as I and the topic author has tried different approaches and we are not getting which approach was the best for us</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1550208,
      "author_name": "inversion",
      "author_url": "",
      "post_date": "2021-10-19T14:15:51.950000",
      "content": "<p>The reason was to ensure the labels of the Private test set were not able to be probed after the competition.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1550442,
          "author_name": "Krish Yadav",
          "author_url": "",
          "post_date": "2021-10-19T18:18:01.513000",
          "content": "<p>Ok thanks, but we wanted to know if the Max_trials parameter had any effect in PLB, so is there any way to do it?</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1549526,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-10-19T03:02:46.820000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1549498": "Hey guys many of our submissions have -1.00000 in PLB, how can that be possible?\n\nAre only the 2 files chosen for submissions checked?\n",
    "1549614": "I assume that `-1` means Kaggle didn't compute (i.e. will not reveal) the private score. Kaggle said [here][1] that they were not going to compute all the private scores.\n\n[1]: https://www.kaggle.com/c/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278921",
    "1550208": "The reason was to ensure the labels of the Private test set were not able to be probed after the competition.",
    "1549526": ""
  }
}