{
  "id": 420359,
  "title": "20th place CV vs LB(public/private) scores",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/420359",
  "author_name": "",
  "post_date": "2023-06-30T12:33:44.274880200Z",
  "votes": 9,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hello, everyone.</p>\n<p>This competition was my first participation in Kaggle, and this post is my first submission.</p>\n<p>Luckily, I was able to go up from 43th in the public leaderboard to 20th in the private leaderboard, <br>\nbut the relationship between the CV scores and LB scores has greatly confused me.</p>\n<p>In the end, I chose three submissions : ①trust my CV, ②trust public LB, ③between ① &amp; ②<br>\nAs a result, I achieved the 20th position with the \"①trust my CV\" submission.</p>\n<p>The relationship between CV score and public/private scores is as follows:<br>\n<strong>CV vs Public: -0.576159</strong><br>\n<strong>CV vs Private: 0.506870</strong></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7311235%2Fb805e2672bbcb421d78e3ace1dd7033a%2Foutput.png?generation=1688128230098040&amp;alt=media\" alt=\"\"></p>\n<p>Although the number of features and models used were different, there seemed to be a positive correlation between the CV scores and the Private scores.</p>\n<p>I am a bit disappointed that I couldn't make the best submission. Is this issue common among Kagglers?<br>\nIt's quite shocking, but I will learn from this experience for the next time.</p>\n<p>It was a fun competition. Thank you.</p>\n<p>Regenerate response</p>",
  "messages": [
    {
      "id": "2324163",
      "postDate": "06/30/2023 12:33:44",
      "content": "<p>Hello, everyone.</p>\n<p>This competition was my first participation in Kaggle, and this post is my first submission.</p>\n<p>Luckily, I was able to go up from 43th in the public leaderboard to 20th in the private leaderboard, <br>\nbut the relationship between the CV scores and LB scores has greatly confused me.</p>\n<p>In the end, I chose three submissions : ①trust my CV, ②trust public LB, ③between ① &amp; ②<br>\nAs a result, I achieved the 20th position with the \"①trust my CV\" submission.</p>\n<p>The relationship between CV score and public/private scores is as follows:<br>\n<strong>CV vs Public: -0.576159</strong><br>\n<strong>CV vs Private: 0.506870</strong></p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7311235%2Fb805e2672bbcb421d78e3ace1dd7033a%2Foutput.png?generation=1688128230098040&amp;alt=media\" alt=\"\"></p>\n<p>Although the number of features and models used were different, there seemed to be a positive correlation between the CV scores and the Private scores.</p>\n<p>I am a bit disappointed that I couldn't make the best submission. Is this issue common among Kagglers?<br>\nIt's quite shocking, but I will learn from this experience for the next time.</p>\n<p>It was a fun competition. Thank you.</p>\n<p>Regenerate response</p>",
      "rawMarkdown": "Hello, everyone.\n\nThis competition was my first participation in Kaggle, and this post is my first submission.\n\nLuckily, I was able to go up from 43th in the public leaderboard to 20th in the private leaderboard, \nbut the relationship between the CV scores and LB scores has greatly confused me.\n\nIn the end, I chose three submissions : ①trust my CV, ②trust public LB, ③between ① & ②\nAs a result, I achieved the 20th position with the \"①trust my CV\" submission.\n\nThe relationship between CV score and public/private scores is as follows:\n**CV vs Public: -0.576159**\n**CV vs Private: 0.506870**\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7311235%2Fb805e2672bbcb421d78e3ace1dd7033a%2Foutput.png?generation=1688128230098040&alt=media)\n\nAlthough the number of features and models used were different, there seemed to be a positive correlation between the CV scores and the Private scores.\n\nI am a bit disappointed that I couldn't make the best submission. Is this issue common among Kagglers?\nIt's quite shocking, but I will learn from this experience for the next time.\n\nIt was a fun competition. Thank you.\n\n\n\n\n\n\nRegenerate response",
      "votes": null
    },
    {
      "id": "2324543",
      "postDate": "06/30/2023 17:08:13",
      "content": "<p>Reading through the solutions, I believe most teams, including many top-ranks, fail to select their highest-private-score submissions. The most robust case is the 1st position - 0.705 for all CV, public and private LB. What a beast!</p>",
      "rawMarkdown": "Reading through the solutions, I believe most teams, including many top-ranks, fail to select their highest-private-score submissions. The most robust case is the 1st position - 0.705 for all CV, public and private LB. What a beast!",
      "votes": null
    },
    {
      "id": "2324976",
      "postDate": "07/01/2023 04:05:19",
      "content": "<p>it would be interesting to have an indicative LB based on the \"Highest-Private-Scores\". For each team, the best private score would be selected and a ranking would be published. We all know our own best Private Score but we don't see the other participants best private scores.</p>",
      "rawMarkdown": "it would be interesting to have an indicative LB based on the \"Highest-Private-Scores\". For each team, the best private score would be selected and a ranking would be published. We all know our own best Private Score but we don't see the other participants best private scores.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2324543,
      "author_name": "hoangnguyen719",
      "author_url": "",
      "post_date": "06/30/2023 17:08:13",
      "content": "<p>Reading through the solutions, I believe most teams, including many top-ranks, fail to select their highest-private-score submissions. The most robust case is the 1st position - 0.705 for all CV, public and private LB. What a beast!</p>",
      "votes": null,
      "replies": [
        {
          "id": 2324976,
          "author_name": "gehallak",
          "author_url": "",
          "post_date": "07/01/2023 04:05:19",
          "content": "<p>it would be interesting to have an indicative LB based on the \"Highest-Private-Scores\". For each team, the best private score would be selected and a ranking would be published. We all know our own best Private Score but we don't see the other participants best private scores.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2324163": "Hello, everyone.\n\nThis competition was my first participation in Kaggle, and this post is my first submission.\n\nLuckily, I was able to go up from 43th in the public leaderboard to 20th in the private leaderboard, \nbut the relationship between the CV scores and LB scores has greatly confused me.\n\nIn the end, I chose three submissions : ①trust my CV, ②trust public LB, ③between ① & ②\nAs a result, I achieved the 20th position with the \"①trust my CV\" submission.\n\nThe relationship between CV score and public/private scores is as follows:\n**CV vs Public: -0.576159**\n**CV vs Private: 0.506870**\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7311235%2Fb805e2672bbcb421d78e3ace1dd7033a%2Foutput.png?generation=1688128230098040&alt=media)\n\nAlthough the number of features and models used were different, there seemed to be a positive correlation between the CV scores and the Private scores.\n\nI am a bit disappointed that I couldn't make the best submission. Is this issue common among Kagglers?\nIt's quite shocking, but I will learn from this experience for the next time.\n\nIt was a fun competition. Thank you.\n\n\n\n\n\n\nRegenerate response",
    "2324543": "Reading through the solutions, I believe most teams, including many top-ranks, fail to select their highest-private-score submissions. The most robust case is the 1st position - 0.705 for all CV, public and private LB. What a beast!",
    "2324976": "it would be interesting to have an indicative LB based on the \"Highest-Private-Scores\". For each team, the best private score would be selected and a ranking would be published. We all know our own best Private Score but we don't see the other participants best private scores."
  },
  "source": "meta"
}