{
  "id": 89961,
  "title": "does public LB score exactly corresponds to private LB?",
  "url": "/competitions/imet-2019-fgvc6/discussion/89961",
  "author_name": "",
  "post_date": "2019-04-19T04:52:30.194117600Z",
  "votes": 4,
  "comment_count": 7,
  "views": 0,
  "content": "<p>It states that \"The private leaderboard is calculated over the same rows as the public leaderboard in this competition.\"\ndoes this mean we do not have to worry about the private leaderboard score because it is evaluated with same test set? Am I right?\nthanks and have a nice day!</p>",
  "messages": [
    {
      "id": "519503",
      "postDate": "04/19/2019 04:52:30",
      "content": "<p>It states that \"The private leaderboard is calculated over the same rows as the public leaderboard in this competition.\"\ndoes this mean we do not have to worry about the private leaderboard score because it is evaluated with same test set? Am I right?\nthanks and have a nice day!</p>",
      "rawMarkdown": "It states that \"The private leaderboard is calculated over the same rows as the public leaderboard in this competition.\"\ndoes this mean we do not have to worry about the private leaderboard score because it is evaluated with same test set? Am I right?\nthanks and have a nice day!",
      "votes": null
    },
    {
      "id": "519547",
      "postDate": "04/19/2019 07:15:24",
      "content": "<p>This stage - yes, same test set.</p>",
      "rawMarkdown": "This stage - yes, same test set.",
      "votes": null
    },
    {
      "id": "519861",
      "postDate": "04/19/2019 18:39:59",
      "content": "<p>No, this is a two stages competition. Actually, the private score will be evaluated on another test dataset, which we don't have access to (yet). That message on the leaderboard page is not correct. Carefully read the rules and the forum.</p>",
      "rawMarkdown": "No, this is a two stages competition. Actually, the private score will be evaluated on another test dataset, which we don't have access to (yet). That message on the leaderboard page is not correct. Carefully read the rules and the forum.",
      "votes": null
    },
    {
      "id": "520079",
      "postDate": "04/20/2019 05:56:20",
      "content": "<p>You can find the following statement at <a href=\"https://www.kaggle.com/c/imet-2019-fgvc6/data\">Data Description</a>.</p>\n\n<blockquote>\n  <p>This is a kernels-only competition <strong>with two stages</strong>. After the deadline, Kaggle will rerun your selected kernels <strong>on an unseen test set</strong>. The second-stage test set is approximately five times the size of the first. You should plan your kernel's memory, disk, and runtime footprint accordingly.</p>\n</blockquote>",
      "rawMarkdown": "You can find the following statement at [Data Description](https://www.kaggle.com/c/imet-2019-fgvc6/data).\n\n&gt; This is a kernels-only competition **with two stages**. After the deadline, Kaggle will rerun your selected kernels **on an unseen test set**. The second-stage test set is approximately five times the size of the first. You should plan your kernel's memory, disk, and runtime footprint accordingly.",
      "votes": null
    },
    {
      "id": "520087",
      "postDate": "04/20/2019 06:17:52",
      "content": "<p>oh thanks I missed that point. so second stage is different to the first stage test set. Then how about the distribution of the test sets? could we say that the first stage test set and second stage test set has similar class distribution? </p>",
      "rawMarkdown": "oh thanks I missed that point. so second stage is different to the first stage test set. Then how about the distribution of the test sets? could we say that the first stage test set and second stage test set has similar class distribution?",
      "votes": null
    },
    {
      "id": "520088",
      "postDate": "04/20/2019 06:18:38",
      "content": "<p>thanks! unseen meaning we can't get any info about it right?</p>",
      "rawMarkdown": "thanks! unseen meaning we can't get any info about it right?",
      "votes": null
    },
    {
      "id": "520101",
      "postDate": "04/20/2019 07:03:53",
      "content": "<p>Yes, except for the size.</p>\n\n<blockquote>\n  <p>The second-stage test set is approximately five times the size of the first. </p>\n</blockquote>",
      "rawMarkdown": "Yes, except for the size.\n\n&gt; The second-stage test set is approximately five times the size of the first.",
      "votes": null
    },
    {
      "id": "520184",
      "postDate": "04/20/2019 11:22:40",
      "content": "<p>We don't know. I wouldn't rely on that.</p>",
      "rawMarkdown": "We don't know. I wouldn't rely on that.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 519547,
      "author_name": "konradb",
      "author_url": "",
      "post_date": "04/19/2019 07:15:24",
      "content": "<p>This stage - yes, same test set.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 519861,
      "author_name": "artyomp",
      "author_url": "",
      "post_date": "04/19/2019 18:39:59",
      "content": "<p>No, this is a two stages competition. Actually, the private score will be evaluated on another test dataset, which we don't have access to (yet). That message on the leaderboard page is not correct. Carefully read the rules and the forum.</p>",
      "votes": null,
      "replies": [
        {
          "id": 520087,
          "author_name": "yangsaewon",
          "author_url": "",
          "post_date": "04/20/2019 06:17:52",
          "content": "<p>oh thanks I missed that point. so second stage is different to the first stage test set. Then how about the distribution of the test sets? could we say that the first stage test set and second stage test set has similar class distribution? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 520184,
          "author_name": "artyomp",
          "author_url": "",
          "post_date": "04/20/2019 11:22:40",
          "content": "<p>We don't know. I wouldn't rely on that.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 520079,
      "author_name": "ttahara",
      "author_url": "",
      "post_date": "04/20/2019 05:56:20",
      "content": "<p>You can find the following statement at <a href=\"https://www.kaggle.com/c/imet-2019-fgvc6/data\">Data Description</a>.</p>\n\n<blockquote>\n  <p>This is a kernels-only competition <strong>with two stages</strong>. After the deadline, Kaggle will rerun your selected kernels <strong>on an unseen test set</strong>. The second-stage test set is approximately five times the size of the first. You should plan your kernel's memory, disk, and runtime footprint accordingly.</p>\n</blockquote>",
      "votes": null,
      "replies": [
        {
          "id": 520088,
          "author_name": "yangsaewon",
          "author_url": "",
          "post_date": "04/20/2019 06:18:38",
          "content": "<p>thanks! unseen meaning we can't get any info about it right?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 520101,
          "author_name": "ttahara",
          "author_url": "",
          "post_date": "04/20/2019 07:03:53",
          "content": "<p>Yes, except for the size.</p>\n\n<blockquote>\n  <p>The second-stage test set is approximately five times the size of the first. </p>\n</blockquote>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "519503": "It states that \"The private leaderboard is calculated over the same rows as the public leaderboard in this competition.\"\ndoes this mean we do not have to worry about the private leaderboard score because it is evaluated with same test set? Am I right?\nthanks and have a nice day!",
    "519547": "This stage - yes, same test set.",
    "519861": "No, this is a two stages competition. Actually, the private score will be evaluated on another test dataset, which we don't have access to (yet). That message on the leaderboard page is not correct. Carefully read the rules and the forum.",
    "520079": "You can find the following statement at [Data Description](https://www.kaggle.com/c/imet-2019-fgvc6/data).\n\n&gt; This is a kernels-only competition **with two stages**. After the deadline, Kaggle will rerun your selected kernels **on an unseen test set**. The second-stage test set is approximately five times the size of the first. You should plan your kernel's memory, disk, and runtime footprint accordingly.",
    "520087": "oh thanks I missed that point. so second stage is different to the first stage test set. Then how about the distribution of the test sets? could we say that the first stage test set and second stage test set has similar class distribution?",
    "520088": "thanks! unseen meaning we can't get any info about it right?",
    "520101": "Yes, except for the size.\n\n&gt; The second-stage test set is approximately five times the size of the first.",
    "520184": "We don't know. I wouldn't rely on that."
  },
  "source": "meta"
}