{
  "id": 416380,
  "title": "Duplication of \"coordinates\"?",
  "url": "/competitions/hubmap-hacking-the-human-vasculature/discussion/416380",
  "author_name": "",
  "post_date": "2023-06-11T05:18:29.297406200Z",
  "votes": 10,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I check several annotations in <code>polygons.jsonl</code>, there are many images with exactly the same <code>coordinates</code> repeate more than once</p>\n<p>for example,  below polygon is repeated twice in image <code>adadaeaa3635</code><br>\n{\"type\":\"blood_vessel\",\"coordinates\":[[[388,469],[387,469],[386,469],[385,469],[384,469],[383,469],[383,468],[382,468],[382,467],[381,467],[381,466],[380,466],[380,465],[379,465],[379,464],[379,463],[378,463],[377,463],[376,463],[376,462],[375,462],[375,461],[374,461],[374,460],[374,459],[374,458],[374,457],[374,456],[374,455],[374,454],[374,453],[374,452],[374,451],[375,450],[376,450],[377,450],[378,450],[379,450],[380,450],[381,450],[381,451],[382,451],[382,452],[383,452],[383,453],[384,453],[384,454],[385,454],[385,455],[386,455],[386,456],[387,456],[387,457],[388,457],[388,458],[388,459],[389,459],[389,460],[390,460],[390,461],[391,461],[391,462],[392,462],[392,463],[392,464],[392,465],[392,466],[392,467],[392,467],[391,467],[390,467],[389,467],[388,468],[388,469],[388,469]]]}</p>\n<p>.</p>\n<p>I wonder if the test set contains duplications of annotation? and the reason behind it</p>",
  "messages": [
    {
      "id": "2295563",
      "postDate": "06/11/2023 05:18:29",
      "content": "<p>I check several annotations in <code>polygons.jsonl</code>, there are many images with exactly the same <code>coordinates</code> repeate more than once</p>\n<p>for example,  below polygon is repeated twice in image <code>adadaeaa3635</code><br>\n{\"type\":\"blood_vessel\",\"coordinates\":[[[388,469],[387,469],[386,469],[385,469],[384,469],[383,469],[383,468],[382,468],[382,467],[381,467],[381,466],[380,466],[380,465],[379,465],[379,464],[379,463],[378,463],[377,463],[376,463],[376,462],[375,462],[375,461],[374,461],[374,460],[374,459],[374,458],[374,457],[374,456],[374,455],[374,454],[374,453],[374,452],[374,451],[375,450],[376,450],[377,450],[378,450],[379,450],[380,450],[381,450],[381,451],[382,451],[382,452],[383,452],[383,453],[384,453],[384,454],[385,454],[385,455],[386,455],[386,456],[387,456],[387,457],[388,457],[388,458],[388,459],[389,459],[389,460],[390,460],[390,461],[391,461],[391,462],[392,462],[392,463],[392,464],[392,465],[392,466],[392,467],[392,467],[391,467],[390,467],[389,467],[388,468],[388,469],[388,469]]]}</p>\n<p>.</p>\n<p>I wonder if the test set contains duplications of annotation? and the reason behind it</p>",
      "rawMarkdown": "I check several annotations in `polygons.jsonl`, there are many images with exactly the same `coordinates` repeate more than once\n\nfor example,  below polygon is repeated twice in image `adadaeaa3635`\n{\"type\":\"blood_vessel\",\"coordinates\":[[[388,469],[387,469],[386,469],[385,469],[384,469],[383,469],[383,468],[382,468],[382,467],[381,467],[381,466],[380,466],[380,465],[379,465],[379,464],[379,463],[378,463],[377,463],[376,463],[376,462],[375,462],[375,461],[374,461],[374,460],[374,459],[374,458],[374,457],[374,456],[374,455],[374,454],[374,453],[374,452],[374,451],[375,450],[376,450],[377,450],[378,450],[379,450],[380,450],[381,450],[381,451],[382,451],[382,452],[383,452],[383,453],[384,453],[384,454],[385,454],[385,455],[386,455],[386,456],[387,456],[387,457],[388,457],[388,458],[388,459],[389,459],[389,460],[390,460],[390,461],[391,461],[391,462],[392,462],[392,463],[392,464],[392,465],[392,466],[392,467],[392,467],[391,467],[390,467],[389,467],[388,468],[388,469],[388,469]]]}\n\n.\n\nI wonder if the test set contains duplications of annotation? and the reason behind it",
      "votes": null
    },
    {
      "id": "2295738",
      "postDate": "06/11/2023 08:11:22",
      "content": "<p>found the same thing when YOLO complaint about it:</p>\n<pre><code>duplicate labels \n</code></pre>",
      "rawMarkdown": "found the same thing when YOLO complaint about it:\n```\n7 duplicate labels removed\n```",
      "votes": null
    },
    {
      "id": "2295815",
      "postDate": "06/11/2023 09:10:18",
      "content": "<p><a href=\"https://www.kaggle.com/code/fnands/a-quick-yolov7-baseline\" target=\"_blank\">Same </a>. <br>\nLooking at the output from YOLO this seems to happen a lot. <br>\nNot really an issue in this case, as the YOLO dataloader filters it out, but kinda annoying. </p>\n<p>It might be a good idea to create a filtered version of it. </p>",
      "rawMarkdown": "[Same ](https://www.kaggle.com/code/fnands/a-quick-yolov7-baseline). \nLooking at the output from YOLO this seems to happen a lot. \nNot really an issue in this case, as the YOLO dataloader filters it out, but kinda annoying. \n\nIt might be a good idea to create a filtered version of it.",
      "votes": null
    },
    {
      "id": "2296001",
      "postDate": "06/11/2023 13:15:08",
      "content": "<p>yeah, if using other tools we just don't know if these will be filtered. So it is better to filter these out in the very first place.</p>",
      "rawMarkdown": "yeah, if using other tools we just don't know if these will be filtered. So it is better to filter these out in the very first place.",
      "votes": null
    },
    {
      "id": "2296136",
      "postDate": "06/11/2023 15:10:14",
      "content": "<p>I created a de-duplicated version of the labels <a href=\"https://www.kaggle.com/datasets/fnands/de-duplicated-annotations-for-hubmap-hhv\" target=\"_blank\">here</a>. </p>\n<p>About 6.5% of the annotations are duplicates. </p>",
      "rawMarkdown": "I created a de-duplicated version of the labels [here](https://www.kaggle.com/datasets/fnands/de-duplicated-annotations-for-hubmap-hhv). \n\nAbout 6.5% of the annotations are duplicates.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2295738,
      "author_name": "snaker",
      "author_url": "",
      "post_date": "06/11/2023 08:11:22",
      "content": "<p>found the same thing when YOLO complaint about it:</p>\n<pre><code>duplicate labels \n</code></pre>",
      "votes": null,
      "replies": [
        {
          "id": 2295815,
          "author_name": "fnands",
          "author_url": "",
          "post_date": "06/11/2023 09:10:18",
          "content": "<p><a href=\"https://www.kaggle.com/code/fnands/a-quick-yolov7-baseline\" target=\"_blank\">Same </a>. <br>\nLooking at the output from YOLO this seems to happen a lot. <br>\nNot really an issue in this case, as the YOLO dataloader filters it out, but kinda annoying. </p>\n<p>It might be a good idea to create a filtered version of it. </p>",
          "votes": null,
          "replies": [
            {
              "id": 2296001,
              "author_name": "snaker",
              "author_url": "",
              "post_date": "06/11/2023 13:15:08",
              "content": "<p>yeah, if using other tools we just don't know if these will be filtered. So it is better to filter these out in the very first place.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2296136,
      "author_name": "fnands",
      "author_url": "",
      "post_date": "06/11/2023 15:10:14",
      "content": "<p>I created a de-duplicated version of the labels <a href=\"https://www.kaggle.com/datasets/fnands/de-duplicated-annotations-for-hubmap-hhv\" target=\"_blank\">here</a>. </p>\n<p>About 6.5% of the annotations are duplicates. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2295563": "I check several annotations in `polygons.jsonl`, there are many images with exactly the same `coordinates` repeate more than once\n\nfor example,  below polygon is repeated twice in image `adadaeaa3635`\n{\"type\":\"blood_vessel\",\"coordinates\":[[[388,469],[387,469],[386,469],[385,469],[384,469],[383,469],[383,468],[382,468],[382,467],[381,467],[381,466],[380,466],[380,465],[379,465],[379,464],[379,463],[378,463],[377,463],[376,463],[376,462],[375,462],[375,461],[374,461],[374,460],[374,459],[374,458],[374,457],[374,456],[374,455],[374,454],[374,453],[374,452],[374,451],[375,450],[376,450],[377,450],[378,450],[379,450],[380,450],[381,450],[381,451],[382,451],[382,452],[383,452],[383,453],[384,453],[384,454],[385,454],[385,455],[386,455],[386,456],[387,456],[387,457],[388,457],[388,458],[388,459],[389,459],[389,460],[390,460],[390,461],[391,461],[391,462],[392,462],[392,463],[392,464],[392,465],[392,466],[392,467],[392,467],[391,467],[390,467],[389,467],[388,468],[388,469],[388,469]]]}\n\n.\n\nI wonder if the test set contains duplications of annotation? and the reason behind it",
    "2295738": "found the same thing when YOLO complaint about it:\n```\n7 duplicate labels removed\n```",
    "2295815": "[Same ](https://www.kaggle.com/code/fnands/a-quick-yolov7-baseline). \nLooking at the output from YOLO this seems to happen a lot. \nNot really an issue in this case, as the YOLO dataloader filters it out, but kinda annoying. \n\nIt might be a good idea to create a filtered version of it.",
    "2296001": "yeah, if using other tools we just don't know if these will be filtered. So it is better to filter these out in the very first place.",
    "2296136": "I created a de-duplicated version of the labels [here](https://www.kaggle.com/datasets/fnands/de-duplicated-annotations-for-hubmap-hhv). \n\nAbout 6.5% of the annotations are duplicates."
  },
  "source": "meta"
}