{
  "id": 230298,
  "title": "Is hand labeling and/or editing of training data allowed?",
  "url": "/competitions/birdclef-2021/discussion/230298",
  "author_name": "",
  "post_date": "2021-04-03T00:43:43.378379700Z",
  "votes": 9,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hello. Thank you for organizing this interesting competition.<br>\nThere is one thing I would like to check before participating.<br>\nIs hand labeling and/or editing of training data allowed?</p>\n<blockquote>\n  <p>We can see that the majority of recordings does not have an annotation of background species. Yet, <strong>it is highly likely that most of them actually contain one or more additional species.</strong></p>\n</blockquote>\n<p>I'm not sure if this will actually be necessary, but I asked the question because I found the above statement in notebook(BirdCLEF2021: Exploring the data).</p>",
  "messages": [
    {
      "id": "1261332",
      "postDate": "04/03/2021 00:43:43",
      "content": "<p>Hello. Thank you for organizing this interesting competition.<br>\nThere is one thing I would like to check before participating.<br>\nIs hand labeling and/or editing of training data allowed?</p>\n<blockquote>\n  <p>We can see that the majority of recordings does not have an annotation of background species. Yet, <strong>it is highly likely that most of them actually contain one or more additional species.</strong></p>\n</blockquote>\n<p>I'm not sure if this will actually be necessary, but I asked the question because I found the above statement in notebook(BirdCLEF2021: Exploring the data).</p>",
      "rawMarkdown": "Hello. Thank you for organizing this interesting competition.\nThere is one thing I would like to check before participating.\nIs hand labeling and/or editing of training data allowed?\n\n> We can see that the majority of recordings does not have an annotation of background species. Yet, **it is highly likely that most of them actually contain one or more additional species.**\n\nI'm not sure if this will actually be necessary, but I asked the question because I found the above statement in notebook(BirdCLEF2021: Exploring the data).",
      "votes": null
    },
    {
      "id": "1261677",
      "postDate": "04/03/2021 10:42:30",
      "content": "<p>Usually with the training data you can do whatever you like to leverage as much information is possible - and yes hand/autom labelling is also allowed. You can confirm this by looking to past similar competitions (RFCX, eBird etc.) </p>",
      "rawMarkdown": "Usually with the training data you can do whatever you like to leverage as much information is possible - and yes hand/autom labelling is also allowed. You can confirm this by looking to past similar competitions (RFCX, eBird etc.)",
      "votes": null
    },
    {
      "id": "1261726",
      "postDate": "04/03/2021 11:38:46",
      "content": "<p>Yes, it is allowed. That being said, creating strong labels is extremely time consuming. Our work often focuses on many species with a large vocal repertoire. Because of time and personnel constraints, we frequently work with weakly labeled data.</p>",
      "rawMarkdown": "Yes, it is allowed. That being said, creating strong labels is extremely time consuming. Our work often focuses on many species with a large vocal repertoire. Because of time and personnel constraints, we frequently work with weakly labeled data.",
      "votes": null
    },
    {
      "id": "1262250",
      "postDate": "04/04/2021 02:39:44",
      "content": "<p>Thank you for the quick response and clarifying the rules.</p>",
      "rawMarkdown": "Thank you for the quick response and clarifying the rules.",
      "votes": null
    },
    {
      "id": "1265281",
      "postDate": "04/06/2021 18:57:16",
      "content": "<p>Just to add, if you <em>do</em> go to the trouble of hand-segmenting the training data, please consider releasing your labels at the end of the competition! (With bonus brownie points for including a few notes on your methodology.) The segmented data will be helpful for future researchers.</p>",
      "rawMarkdown": "Just to add, if you *do* go to the trouble of hand-segmenting the training data, please consider releasing your labels at the end of the competition! (With bonus brownie points for including a few notes on your methodology.) The segmented data will be helpful for future researchers.",
      "votes": null
    },
    {
      "id": "1269271",
      "postDate": "04/10/2021 11:28:59",
      "content": "<p>Thank you for comment.<br>\nOK. I don't know if I'll do hand-segmenting the training data yet, but when I do, I'll release it!</p>",
      "rawMarkdown": "Thank you for comment.\nOK. I don't know if I'll do hand-segmenting the training data yet, but when I do, I'll release it!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1261677,
      "author_name": "imeintanis",
      "author_url": "",
      "post_date": "04/03/2021 10:42:30",
      "content": "<p>Usually with the training data you can do whatever you like to leverage as much information is possible - and yes hand/autom labelling is also allowed. You can confirm this by looking to past similar competitions (RFCX, eBird etc.) </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1261726,
      "author_name": "holgerklinck",
      "author_url": "",
      "post_date": "04/03/2021 11:38:46",
      "content": "<p>Yes, it is allowed. That being said, creating strong labels is extremely time consuming. Our work often focuses on many species with a large vocal repertoire. Because of time and personnel constraints, we frequently work with weakly labeled data.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1262250,
          "author_name": "naoism",
          "author_url": "",
          "post_date": "04/04/2021 02:39:44",
          "content": "<p>Thank you for the quick response and clarifying the rules.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1265281,
          "author_name": "tomdenton",
          "author_url": "",
          "post_date": "04/06/2021 18:57:16",
          "content": "<p>Just to add, if you <em>do</em> go to the trouble of hand-segmenting the training data, please consider releasing your labels at the end of the competition! (With bonus brownie points for including a few notes on your methodology.) The segmented data will be helpful for future researchers.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1269271,
          "author_name": "naoism",
          "author_url": "",
          "post_date": "04/10/2021 11:28:59",
          "content": "<p>Thank you for comment.<br>\nOK. I don't know if I'll do hand-segmenting the training data yet, but when I do, I'll release it!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1261332": "Hello. Thank you for organizing this interesting competition.\nThere is one thing I would like to check before participating.\nIs hand labeling and/or editing of training data allowed?\n\n> We can see that the majority of recordings does not have an annotation of background species. Yet, **it is highly likely that most of them actually contain one or more additional species.**\n\nI'm not sure if this will actually be necessary, but I asked the question because I found the above statement in notebook(BirdCLEF2021: Exploring the data).",
    "1261677": "Usually with the training data you can do whatever you like to leverage as much information is possible - and yes hand/autom labelling is also allowed. You can confirm this by looking to past similar competitions (RFCX, eBird etc.)",
    "1261726": "Yes, it is allowed. That being said, creating strong labels is extremely time consuming. Our work often focuses on many species with a large vocal repertoire. Because of time and personnel constraints, we frequently work with weakly labeled data.",
    "1262250": "Thank you for the quick response and clarifying the rules.",
    "1265281": "Just to add, if you *do* go to the trouble of hand-segmenting the training data, please consider releasing your labels at the end of the competition! (With bonus brownie points for including a few notes on your methodology.) The segmented data will be helpful for future researchers.",
    "1269271": "Thank you for comment.\nOK. I don't know if I'll do hand-segmenting the training data yet, but when I do, I'll release it!"
  },
  "source": "meta"
}