{
  "id": 582454,
  "title": "Kaggle Leaderboard Scoring Explained for Beginners",
  "url": "/competitions/image-matching-challenge-2025/discussion/582454",
  "author_name": "",
  "post_date": "2025-05-31T11:09:48.723965Z",
  "votes": 2,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I'm a beginner on Kaggle. On the Public Leaderboard, it says:<br>\n<code>\"This leaderboard is calculated with approximately 50% of the test data. The final results will be based on the other 50%, so the final standings may be different.\"</code></p>\n<p>What does this mean exactly?<br>\nDoes it mean:<br>\n① The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown?<br>\nor<br>\n② The score shown on the Public Leaderboard is calculated using 50% of the test set, and the final score will be recalculated using the remaining 50% upon final submission?<br>\nWhich one is correct?</p>\n<p>I’m a bit worried about the runtime limits during submission.</p>\n<p>Thank you for your kindness!</p>",
  "messages": [
    {
      "id": "3214354",
      "postDate": "05/31/2025 11:09:48",
      "content": "<p>I'm a beginner on Kaggle. On the Public Leaderboard, it says:<br>\n<code>\"This leaderboard is calculated with approximately 50% of the test data. The final results will be based on the other 50%, so the final standings may be different.\"</code></p>\n<p>What does this mean exactly?<br>\nDoes it mean:<br>\n① The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown?<br>\nor<br>\n② The score shown on the Public Leaderboard is calculated using 50% of the test set, and the final score will be recalculated using the remaining 50% upon final submission?<br>\nWhich one is correct?</p>\n<p>I’m a bit worried about the runtime limits during submission.</p>\n<p>Thank you for your kindness!</p>",
      "rawMarkdown": "I'm a beginner on Kaggle. On the Public Leaderboard, it says:\n`\"This leaderboard is calculated with approximately 50% of the test data. The final results will be based on the other 50%, so the final standings may be different.\"`\n\nWhat does this mean exactly?\nDoes it mean:\n① The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown?\nor\n② The score shown on the Public Leaderboard is calculated using 50% of the test set, and the final score will be recalculated using the remaining 50% upon final submission?\nWhich one is correct?\n\nI’m a bit worried about the runtime limits during submission.\n\nThank you for your kindness!",
      "votes": null
    },
    {
      "id": "3214725",
      "postDate": "06/01/2025 02:16:18",
      "content": "<p>Hello, Oshirikan.<br>\nThe leaderboard score is calculated with half of the test data. For final results the full test dataset will be used.<br>\n Hope this helps </p>",
      "rawMarkdown": "Hello, Oshirikan.\nThe leaderboard score is calculated with half of the test data. For final results the full test dataset will be used.\n Hope this helps",
      "votes": null
    },
    {
      "id": "3214756",
      "postDate": "06/01/2025 03:20:52",
      "content": "<p>The meaning of this sentence is that when you submit a notebook rating, the test set is only half complete, such as 100 images. The public ranking score is only based on 50 of them, while the private ranking score is based on all 100 images, which is your final rating</p>",
      "rawMarkdown": "The meaning of this sentence is that when you submit a notebook rating, the test set is only half complete, such as 100 images. The public ranking score is only based on 50 of them, while the private ranking score is based on all 100 images, which is your final rating",
      "votes": null
    },
    {
      "id": "3215494",
      "postDate": "06/02/2025 10:19:07",
      "content": "<p>The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown. The private ranking score will be based on the rest 50%.</p>",
      "rawMarkdown": "The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown. The private ranking score will be based on the rest 50%.",
      "votes": null
    },
    {
      "id": "3215677",
      "postDate": "06/02/2025 14:36:23",
      "content": "<p>Based on everyone's comments, I have understood the following:</p>\n<ul>\n<li>When submitting, the notebook is executed using 100% of the test data, which is why it takes a long time to complete.</li>\n<li>The Public Leaderboard score is calculated using approximately 50% of the test data.</li>\n<li>The Private Leaderboard (final ranking) is based on the results from the remaining 50% of the test data.</li>\n</ul>",
      "rawMarkdown": "Based on everyone's comments, I have understood the following:\n\n- When submitting, the notebook is executed using 100% of the test data, which is why it takes a long time to complete.\n- The Public Leaderboard score is calculated using approximately 50% of the test data.\n- The Private Leaderboard (final ranking) is based on the results from the remaining 50% of the test data.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3214725,
      "author_name": "alexandersassi",
      "author_url": "",
      "post_date": "06/01/2025 02:16:18",
      "content": "<p>Hello, Oshirikan.<br>\nThe leaderboard score is calculated with half of the test data. For final results the full test dataset will be used.<br>\n Hope this helps </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3214756,
      "author_name": "evansussex",
      "author_url": "",
      "post_date": "06/01/2025 03:20:52",
      "content": "<p>The meaning of this sentence is that when you submit a notebook rating, the test set is only half complete, such as 100 images. The public ranking score is only based on 50 of them, while the private ranking score is based on all 100 images, which is your final rating</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3215494,
      "author_name": "shanzhong8",
      "author_url": "",
      "post_date": "06/02/2025 10:19:07",
      "content": "<p>The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown. The private ranking score will be based on the rest 50%.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3215677,
      "author_name": "perfectoshi",
      "author_url": "",
      "post_date": "06/02/2025 14:36:23",
      "content": "<p>Based on everyone's comments, I have understood the following:</p>\n<ul>\n<li>When submitting, the notebook is executed using 100% of the test data, which is why it takes a long time to complete.</li>\n<li>The Public Leaderboard score is calculated using approximately 50% of the test data.</li>\n<li>The Private Leaderboard (final ranking) is based on the results from the remaining 50% of the test data.</li>\n</ul>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3214354": "I'm a beginner on Kaggle. On the Public Leaderboard, it says:\n`\"This leaderboard is calculated with approximately 50% of the test data. The final results will be based on the other 50%, so the final standings may be different.\"`\n\nWhat does this mean exactly?\nDoes it mean:\n① The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown?\nor\n② The score shown on the Public Leaderboard is calculated using 50% of the test set, and the final score will be recalculated using the remaining 50% upon final submission?\nWhich one is correct?\n\nI’m a bit worried about the runtime limits during submission.\n\nThank you for your kindness!",
    "3214725": "Hello, Oshirikan.\nThe leaderboard score is calculated with half of the test data. For final results the full test dataset will be used.\n Hope this helps",
    "3214756": "The meaning of this sentence is that when you submit a notebook rating, the test set is only half complete, such as 100 images. The public ranking score is only based on 50 of them, while the private ranking score is based on all 100 images, which is your final rating",
    "3215494": "The score shown on the Public Leaderboard is calculated using the entire test set, but only 50% of the results are shown. The private ranking score will be based on the rest 50%.",
    "3215677": "Based on everyone's comments, I have understood the following:\n\n- When submitting, the notebook is executed using 100% of the test data, which is why it takes a long time to complete.\n- The Public Leaderboard score is calculated using approximately 50% of the test data.\n- The Private Leaderboard (final ranking) is based on the results from the remaining 50% of the test data."
  },
  "source": "meta"
}