{
  "id": 307614,
  "title": "Turns out that LB is useless",
  "url": "/competitions/tensorflow-great-barrier-reef/discussion/307614",
  "author_name": "",
  "post_date": "2022-02-15T01:16:55.097865300Z",
  "votes": 21,
  "comment_count": 9,
  "views": 0,
  "content": "<p>according to all the public LB and private LB scores, relying on the high resolution inference, which will give a very high score with LB, will perform bad at private LeaderBoard. We can see that from CV because inference with high resolution also lead to very bad F2 locally.<br>\nI finally chose 4 submissions:</p>\n<ol>\n<li>Highest LB ( LB 0.742, oof 0.6514)</li>\n<li>Highest mean CV + LB  (LB 0.677, oof 0.6987)</li>\n<li>High LB with a solid CV score (LB 0.705, oof 0.687)</li>\n<li>High CV ( LB 0.644, oof 0.702 )</li>\n</ol>\n<p>we don't give much hope to 4, the 3 is our biggest hope. Turns out that the 4 scores 0.737 on private LB.</p>",
  "messages": [
    {
      "id": "1690516",
      "postDate": "02/15/2022 01:16:55",
      "content": "<p>according to all the public LB and private LB scores, relying on the high resolution inference, which will give a very high score with LB, will perform bad at private LeaderBoard. We can see that from CV because inference with high resolution also lead to very bad F2 locally.<br>\nI finally chose 4 submissions:</p>\n<ol>\n<li>Highest LB ( LB 0.742, oof 0.6514)</li>\n<li>Highest mean CV + LB  (LB 0.677, oof 0.6987)</li>\n<li>High LB with a solid CV score (LB 0.705, oof 0.687)</li>\n<li>High CV ( LB 0.644, oof 0.702 )</li>\n</ol>\n<p>we don't give much hope to 4, the 3 is our biggest hope. Turns out that the 4 scores 0.737 on private LB.</p>",
      "rawMarkdown": "according to all the public LB and private LB scores, relying on the high resolution inference, which will give a very high score with LB, will perform bad at private LeaderBoard. We can see that from CV because inference with high resolution also lead to very bad F2 locally.\nI finally chose 4 submissions:\n\n1. Highest LB ( LB 0.742, oof 0.6514)\n2. Highest mean CV + LB  (LB 0.677, oof 0.6987)\n3. High LB with a solid CV score (LB 0.705, oof 0.687)\n4. High CV ( LB 0.644, oof 0.702 )\n\nwe don't give much hope to 4, the 3 is our biggest hope. Turns out that the 4 scores 0.737 on private LB.",
      "votes": null
    },
    {
      "id": "1690523",
      "postDate": "02/15/2022 01:26:05",
      "content": "<p>Congratulation for you 2nd place win and become a Competition Master!</p>",
      "rawMarkdown": "Congratulation for you 2nd place win and become a Competition Master!",
      "votes": null
    },
    {
      "id": "1690526",
      "postDate": "02/15/2022 01:33:02",
      "content": "<p>Thanks again for sharing your cv! my .75 oof is a mystery then</p>",
      "rawMarkdown": "Thanks again for sharing your cv! my .75 oof is a mystery then",
      "votes": null
    },
    {
      "id": "1690583",
      "postDate": "02/15/2022 02:40:31",
      "content": "<p>Glad i can help</p>",
      "rawMarkdown": "Glad i can help",
      "votes": null
    },
    {
      "id": "1690586",
      "postDate": "02/15/2022 02:41:24",
      "content": "<p>Thanks sheep, congradulation on the 1st place win.</p>",
      "rawMarkdown": "Thanks sheep, congradulation on the 1st place win.",
      "votes": null
    },
    {
      "id": "1690589",
      "postDate": "02/15/2022 02:43:15",
      "content": "<p>Indeed.    </p>",
      "rawMarkdown": "Indeed.",
      "votes": null
    },
    {
      "id": "1690786",
      "postDate": "02/15/2022 05:24:31",
      "content": "<p><a href=\"https://www.kaggle.com/bakeryproducts\" target=\"_blank\">@bakeryproducts</a> Same here. 0.75-0.77 CV for 3 folds split by video. ~ 0.76 Public LB. Don't know what went wrong with private lb. Need to investigate in next few days!!</p>",
      "rawMarkdown": "bakeryproducts Same here. 0.75-0.77 CV for 3 folds split by video. ~ 0.76 Public LB. Don't know what went wrong with private lb. Need to investigate in next few days!!",
      "votes": null
    },
    {
      "id": "1690937",
      "postDate": "02/15/2022 06:58:43",
      "content": "<p>Congratulations! Great result <a href=\"https://www.kaggle.com/snaker\" target=\"_blank\">@snaker</a>! 👍👋👋👋<br>\nNice observation. 👍</p>",
      "rawMarkdown": "Congratulations! Great result @snaker! 👍👋👋👋\nNice observation. 👍",
      "votes": null
    },
    {
      "id": "1691089",
      "postDate": "02/15/2022 08:27:34",
      "content": "<p>and thanks for all the contributions you made to this competition, really helped</p>",
      "rawMarkdown": "and thanks for all the contributions you made to this competition, really helped",
      "votes": null
    },
    {
      "id": "1691090",
      "postDate": "02/15/2022 08:27:36",
      "content": "<p><a href=\"https://www.kaggle.com/ks2019\" target=\"_blank\">@ks2019</a>  let me know if you will find something</p>",
      "rawMarkdown": "ks2019  let me know if you will find something",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1690523,
      "author_name": "steamedsheep",
      "author_url": "",
      "post_date": "02/15/2022 01:26:05",
      "content": "<p>Congratulation for you 2nd place win and become a Competition Master!</p>",
      "votes": null,
      "replies": [
        {
          "id": 1690586,
          "author_name": "snaker",
          "author_url": "",
          "post_date": "02/15/2022 02:41:24",
          "content": "<p>Thanks sheep, congradulation on the 1st place win.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1690526,
      "author_name": "bakeryproducts",
      "author_url": "",
      "post_date": "02/15/2022 01:33:02",
      "content": "<p>Thanks again for sharing your cv! my .75 oof is a mystery then</p>",
      "votes": null,
      "replies": [
        {
          "id": 1690583,
          "author_name": "snaker",
          "author_url": "",
          "post_date": "02/15/2022 02:40:31",
          "content": "<p>Glad i can help</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1690786,
          "author_name": "ks2019",
          "author_url": "",
          "post_date": "02/15/2022 05:24:31",
          "content": "<p><a href=\"https://www.kaggle.com/bakeryproducts\" target=\"_blank\">@bakeryproducts</a> Same here. 0.75-0.77 CV for 3 folds split by video. ~ 0.76 Public LB. Don't know what went wrong with private lb. Need to investigate in next few days!!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1691090,
          "author_name": "bakeryproducts",
          "author_url": "",
          "post_date": "02/15/2022 08:27:36",
          "content": "<p><a href=\"https://www.kaggle.com/ks2019\" target=\"_blank\">@ks2019</a>  let me know if you will find something</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1690589,
      "author_name": "robsonsan",
      "author_url": "",
      "post_date": "02/15/2022 02:43:15",
      "content": "<p>Indeed.    </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1690937,
      "author_name": "remekkinas",
      "author_url": "",
      "post_date": "02/15/2022 06:58:43",
      "content": "<p>Congratulations! Great result <a href=\"https://www.kaggle.com/snaker\" target=\"_blank\">@snaker</a>! 👍👋👋👋<br>\nNice observation. 👍</p>",
      "votes": null,
      "replies": [
        {
          "id": 1691089,
          "author_name": "snaker",
          "author_url": "",
          "post_date": "02/15/2022 08:27:34",
          "content": "<p>and thanks for all the contributions you made to this competition, really helped</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1690516": "according to all the public LB and private LB scores, relying on the high resolution inference, which will give a very high score with LB, will perform bad at private LeaderBoard. We can see that from CV because inference with high resolution also lead to very bad F2 locally.\nI finally chose 4 submissions:\n\n1. Highest LB ( LB 0.742, oof 0.6514)\n2. Highest mean CV + LB  (LB 0.677, oof 0.6987)\n3. High LB with a solid CV score (LB 0.705, oof 0.687)\n4. High CV ( LB 0.644, oof 0.702 )\n\nwe don't give much hope to 4, the 3 is our biggest hope. Turns out that the 4 scores 0.737 on private LB.",
    "1690523": "Congratulation for you 2nd place win and become a Competition Master!",
    "1690526": "Thanks again for sharing your cv! my .75 oof is a mystery then",
    "1690583": "Glad i can help",
    "1690586": "Thanks sheep, congradulation on the 1st place win.",
    "1690589": "Indeed.",
    "1690786": "bakeryproducts Same here. 0.75-0.77 CV for 3 folds split by video. ~ 0.76 Public LB. Don't know what went wrong with private lb. Need to investigate in next few days!!",
    "1690937": "Congratulations! Great result @snaker! 👍👋👋👋\nNice observation. 👍",
    "1691089": "and thanks for all the contributions you made to this competition, really helped",
    "1691090": "ks2019  let me know if you will find something"
  },
  "source": "meta"
}