{
  "id": 268017,
  "title": "Discussion: CV & Loss",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/268017",
  "author_name": "",
  "post_date": "2021-08-25T16:10:45.632101300Z",
  "votes": 5,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Since many public notebooks /discussions show their training BCE didn't get below 0.69, and the LB score is just not trust worthy, I think it's beneficial to share our CV &amp; loss to the public so that many of us can understand the current actual progress.</p>\n<p>I'll start with mine.</p>\n<p>EffnetB7 / 256 * 256 * 64 / FLAIR / StratifiedKFold / TF Keras<br>\nCV &amp; Val Loss(5Fold)</p>\n<ol>\n<li>0.62786 / 0.66896</li>\n<li>0.53659 / 0.69920</li>\n<li>0.63726 / 0.65920</li>\n<li>0.58599 / 0.69828</li>\n<li>0.56095 / 0.69355</li>\n</ol>",
  "messages": [
    {
      "id": "1490420",
      "postDate": "08/25/2021 16:10:45",
      "content": "<p>Since many public notebooks /discussions show their training BCE didn't get below 0.69, and the LB score is just not trust worthy, I think it's beneficial to share our CV &amp; loss to the public so that many of us can understand the current actual progress.</p>\n<p>I'll start with mine.</p>\n<p>EffnetB7 / 256 * 256 * 64 / FLAIR / StratifiedKFold / TF Keras<br>\nCV &amp; Val Loss(5Fold)</p>\n<ol>\n<li>0.62786 / 0.66896</li>\n<li>0.53659 / 0.69920</li>\n<li>0.63726 / 0.65920</li>\n<li>0.58599 / 0.69828</li>\n<li>0.56095 / 0.69355</li>\n</ol>",
      "rawMarkdown": "Since many public notebooks /discussions show their training BCE didn't get below 0.69, and the LB score is just not trust worthy, I think it's beneficial to share our CV & loss to the public so that many of us can understand the current actual progress.\n\nI'll start with mine.\n\nEffnetB7 / 256 * 256 * 64 / FLAIR / StratifiedKFold / TF Keras\nCV & Val Loss(5Fold)\n1. 0.62786 / 0.66896\n2. 0.53659 / 0.69920\n3. 0.63726 / 0.65920\n4. 0.58599 / 0.69828\n5. 0.56095 / 0.69355",
      "votes": null
    },
    {
      "id": "1491180",
      "postDate": "08/26/2021 07:55:11",
      "content": "<p>The situation is similar. I won't ask anyone, everyone has a score of about 0.5. As long as there are ideas from discussions and personal ones, I will try. When the ideas run out, I will wait for the end of the competition, when the notebooks with a good score will appear</p>",
      "rawMarkdown": "The situation is similar. I won't ask anyone, everyone has a score of about 0.5. As long as there are ideas from discussions and personal ones, I will try. When the ideas run out, I will wait for the end of the competition, when the notebooks with a good score will appear",
      "votes": null
    },
    {
      "id": "1491433",
      "postDate": "08/26/2021 11:26:44",
      "content": "<p>Yeah, it's just I think sharing these scores can somewhat let every competitors knows that there might be ways/hope in solving the problem if someone has made some real progress.</p>",
      "rawMarkdown": "Yeah, it's just I think sharing these scores can somewhat let every competitors knows that there might be ways/hope in solving the problem if someone has made some real progress.",
      "votes": null
    },
    {
      "id": "1491454",
      "postDate": "08/26/2021 11:51:12",
      "content": "<p>I agree, but it seems that no one knows what's going on at the moment</p>",
      "rawMarkdown": "I agree, but it seems that no one knows what's going on at the moment",
      "votes": null
    },
    {
      "id": "1507271",
      "postDate": "09/09/2021 03:40:05",
      "content": "<p>Yeah, my score wasn't going down either (I actually got it down to 0.59 but no further) and I thought I was doing something wrong. Thanks for clarification.</p>",
      "rawMarkdown": "Yeah, my score wasn't going down either (I actually got it down to 0.59 but no further) and I thought I was doing something wrong. Thanks for clarification.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1491180,
      "author_name": "georgiisirotenko",
      "author_url": "",
      "post_date": "08/26/2021 07:55:11",
      "content": "<p>The situation is similar. I won't ask anyone, everyone has a score of about 0.5. As long as there are ideas from discussions and personal ones, I will try. When the ideas run out, I will wait for the end of the competition, when the notebooks with a good score will appear</p>",
      "votes": null,
      "replies": [
        {
          "id": 1491433,
          "author_name": "gdoong",
          "author_url": "",
          "post_date": "08/26/2021 11:26:44",
          "content": "<p>Yeah, it's just I think sharing these scores can somewhat let every competitors knows that there might be ways/hope in solving the problem if someone has made some real progress.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1491454,
          "author_name": "georgiisirotenko",
          "author_url": "",
          "post_date": "08/26/2021 11:51:12",
          "content": "<p>I agree, but it seems that no one knows what's going on at the moment</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1507271,
      "author_name": "eddwait",
      "author_url": "",
      "post_date": "09/09/2021 03:40:05",
      "content": "<p>Yeah, my score wasn't going down either (I actually got it down to 0.59 but no further) and I thought I was doing something wrong. Thanks for clarification.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1490420": "Since many public notebooks /discussions show their training BCE didn't get below 0.69, and the LB score is just not trust worthy, I think it's beneficial to share our CV & loss to the public so that many of us can understand the current actual progress.\n\nI'll start with mine.\n\nEffnetB7 / 256 * 256 * 64 / FLAIR / StratifiedKFold / TF Keras\nCV & Val Loss(5Fold)\n1. 0.62786 / 0.66896\n2. 0.53659 / 0.69920\n3. 0.63726 / 0.65920\n4. 0.58599 / 0.69828\n5. 0.56095 / 0.69355",
    "1491180": "The situation is similar. I won't ask anyone, everyone has a score of about 0.5. As long as there are ideas from discussions and personal ones, I will try. When the ideas run out, I will wait for the end of the competition, when the notebooks with a good score will appear",
    "1491433": "Yeah, it's just I think sharing these scores can somewhat let every competitors knows that there might be ways/hope in solving the problem if someone has made some real progress.",
    "1491454": "I agree, but it seems that no one knows what's going on at the moment",
    "1507271": "Yeah, my score wasn't going down either (I actually got it down to 0.59 but no further) and I thought I was doing something wrong. Thanks for clarification."
  },
  "source": "meta"
}