{
  "id": 76062,
  "title": "two questions on the training set",
  "url": "/competitions/humpback-whale-identification/discussion/76062",
  "author_name": "",
  "post_date": "2018-12-28T22:30:04.082556200Z",
  "votes": null,
  "comment_count": 7,
  "views": 0,
  "content": "<p>Apologies for the repetition if this is clarified elsewhere.. I did look.\nin the Data Description it says: \"What makes this such a challenge is that there are only a few examples for each of 3,000+ whale Ids\". However, we find 5004 whale IDs in the training set (excluding new_whale). Why does the description say 3000+ and not 5000+?</p>\n\n<p>Also, do we know if the training examples that are labeled new_whale belong to the 3000+ (or 5004), but have simple no been manually labeled like the rest of the training set? or could those new_whale examples belong to whales NOT in the 5004 present in the training set?</p>",
  "messages": [
    {
      "id": "446941",
      "postDate": "12/28/2018 22:30:04",
      "content": "<p>Apologies for the repetition if this is clarified elsewhere.. I did look.\nin the Data Description it says: \"What makes this such a challenge is that there are only a few examples for each of 3,000+ whale Ids\". However, we find 5004 whale IDs in the training set (excluding new_whale). Why does the description say 3000+ and not 5000+?</p>\n\n<p>Also, do we know if the training examples that are labeled new_whale belong to the 3000+ (or 5004), but have simple no been manually labeled like the rest of the training set? or could those new_whale examples belong to whales NOT in the 5004 present in the training set?</p>",
      "rawMarkdown": "Apologies for the repetition if this is clarified elsewhere.. I did look.\nin the Data Description it says: \"What makes this such a challenge is that there are only a few examples for each of 3,000+ whale Ids\". However, we find 5004 whale IDs in the training set (excluding new_whale). Why does the description say 3000+ and not 5000+?\n\nAlso, do we know if the training examples that are labeled new_whale belong to the 3000+ (or 5004), but have simple no been manually labeled like the rest of the training set? or could those new_whale examples belong to whales NOT in the 5004 present in the training set?",
      "votes": null
    },
    {
      "id": "447172",
      "postDate": "12/29/2018 09:46:13",
      "content": "<p>Total: 5005 IDs（5004+new_whale）.\nLess than 3 images per ID: about 3000 IDs.\nMore than 3 images per ID: about 2000 IDs.\nnew_whale: not labeled.</p>",
      "rawMarkdown": "Total: 5005 IDs（5004+new_whale）.\nLess than 3 images per ID: about 3000 IDs.\nMore than 3 images per ID: about 2000 IDs.\nnew_whale: not labeled.",
      "votes": null
    },
    {
      "id": "447420",
      "postDate": "12/29/2018 19:33:18",
      "content": "<p>ok, maybe I read too much into the description.</p>",
      "rawMarkdown": "ok, maybe I read too much into the description.",
      "votes": null
    },
    {
      "id": "451432",
      "postDate": "01/07/2019 04:58:39",
      "content": "<p>is that every ID means a unique individual whale?\nis that possible new_whale have the same whale?\nI'll appreciate it if you can reply me.</p>",
      "rawMarkdown": "is that every ID means a unique individual whale?\nis that possible new_whale have the same whale?\nI'll appreciate it if you can reply me.",
      "votes": null
    },
    {
      "id": "452806",
      "postDate": "01/09/2019 07:11:24",
      "content": "<p>Every unique id represents a different type of whale. So there are 5005 different whale types.</p>",
      "rawMarkdown": "Every unique id represents a different type of whale. So there are 5005 different whale types.",
      "votes": null
    },
    {
      "id": "453372",
      "postDate": "01/10/2019 04:40:31",
      "content": "<p>new_whale is not one type, but a lot of types.</p>",
      "rawMarkdown": "new_whale is not one type, but a lot of types.",
      "votes": null
    },
    {
      "id": "453678",
      "postDate": "01/10/2019 15:42:23",
      "content": "<p>yes, thanks for adding that Lu Yang.</p>",
      "rawMarkdown": "yes, thanks for adding that Lu Yang.",
      "votes": null
    },
    {
      "id": "456558",
      "postDate": "01/16/2019 03:53:03",
      "content": "<p>Hi, I am also confused about this and here is my opinion:\n  every ID means a unique individual whale(whales that scientists are currently tracking), because it is weird to give a species 5000+ types.\n  class new_whale just means whales that are not being tracked, this may contain many types.</p>",
      "rawMarkdown": "Hi, I am also confused about this and here is my opinion:\n  every ID means a unique individual whale(whales that scientists are currently tracking), because it is weird to give a species 5000+ types.\n  class new_whale just means whales that are not being tracked, this may contain many types.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 447172,
      "author_name": "luyang2018",
      "author_url": "",
      "post_date": "12/29/2018 09:46:13",
      "content": "<p>Total: 5005 IDs（5004+new_whale）.\nLess than 3 images per ID: about 3000 IDs.\nMore than 3 images per ID: about 2000 IDs.\nnew_whale: not labeled.</p>",
      "votes": null,
      "replies": [
        {
          "id": 447420,
          "author_name": "kmaayah",
          "author_url": "",
          "post_date": "12/29/2018 19:33:18",
          "content": "<p>ok, maybe I read too much into the description.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 451432,
          "author_name": "wanghanlinfighter",
          "author_url": "",
          "post_date": "01/07/2019 04:58:39",
          "content": "<p>is that every ID means a unique individual whale?\nis that possible new_whale have the same whale?\nI'll appreciate it if you can reply me.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 452806,
          "author_name": "dnandanr",
          "author_url": "",
          "post_date": "01/09/2019 07:11:24",
          "content": "<p>Every unique id represents a different type of whale. So there are 5005 different whale types.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 453372,
          "author_name": "luyang2018",
          "author_url": "",
          "post_date": "01/10/2019 04:40:31",
          "content": "<p>new_whale is not one type, but a lot of types.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 453678,
          "author_name": "dnandanr",
          "author_url": "",
          "post_date": "01/10/2019 15:42:23",
          "content": "<p>yes, thanks for adding that Lu Yang.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 456558,
          "author_name": "huxiang",
          "author_url": "",
          "post_date": "01/16/2019 03:53:03",
          "content": "<p>Hi, I am also confused about this and here is my opinion:\n  every ID means a unique individual whale(whales that scientists are currently tracking), because it is weird to give a species 5000+ types.\n  class new_whale just means whales that are not being tracked, this may contain many types.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "446941": "Apologies for the repetition if this is clarified elsewhere.. I did look.\nin the Data Description it says: \"What makes this such a challenge is that there are only a few examples for each of 3,000+ whale Ids\". However, we find 5004 whale IDs in the training set (excluding new_whale). Why does the description say 3000+ and not 5000+?\n\nAlso, do we know if the training examples that are labeled new_whale belong to the 3000+ (or 5004), but have simple no been manually labeled like the rest of the training set? or could those new_whale examples belong to whales NOT in the 5004 present in the training set?",
    "447172": "Total: 5005 IDs（5004+new_whale）.\nLess than 3 images per ID: about 3000 IDs.\nMore than 3 images per ID: about 2000 IDs.\nnew_whale: not labeled.",
    "447420": "ok, maybe I read too much into the description.",
    "451432": "is that every ID means a unique individual whale?\nis that possible new_whale have the same whale?\nI'll appreciate it if you can reply me.",
    "452806": "Every unique id represents a different type of whale. So there are 5005 different whale types.",
    "453372": "new_whale is not one type, but a lot of types.",
    "453678": "yes, thanks for adding that Lu Yang.",
    "456558": "Hi, I am also confused about this and here is my opinion:\n  every ID means a unique individual whale(whales that scientists are currently tracking), because it is weird to give a species 5000+ types.\n  class new_whale just means whales that are not being tracked, this may contain many types."
  },
  "source": "meta"
}