{
  "id": 241543,
  "title": "Duplicate Images with Different Bounding Boxes",
  "url": "/competitions/siim-covid19-detection/discussion/241543",
  "author_name": "",
  "post_date": "2021-05-25T02:52:32.104945Z",
  "votes": 11,
  "comment_count": 4,
  "views": 0,
  "content": "<p>As others have pointed out, the dataset contains several duplicate images. The following notebook contains all groups of the same or similar images with bounding boxes. I have found 74 groups of similar or the same image.</p>\n<p><a href=\"https://www.kaggle.com/kwk100/siim-covid-19-duplicate-training-images\" target=\"_blank\">siim-covid-19-duplicate-training-images</a></p>\n<p>In some groups of duplicate images, only one image has bounding boxes.</p>\n<p><img src=\"https://i.ibb.co/br9Xg6h/results-13-3.png\" alt=\"\"></p>\n<p>In one case, the same image is included in the training set with different bounding boxes marked. </p>\n<p><img src=\"https://i.ibb.co/mvZrVGY/results-13-19.png\" alt=\"\"></p>\n<p>How do you plan on handling the duplicate images? Obviously, duplicate images can be dropped from the dataset. In this case, keep only the ones with bounding boxes?</p>",
  "messages": [
    {
      "id": "1321827",
      "postDate": "05/25/2021 02:52:32",
      "content": "<p>As others have pointed out, the dataset contains several duplicate images. The following notebook contains all groups of the same or similar images with bounding boxes. I have found 74 groups of similar or the same image.</p>\n<p><a href=\"https://www.kaggle.com/kwk100/siim-covid-19-duplicate-training-images\" target=\"_blank\">siim-covid-19-duplicate-training-images</a></p>\n<p>In some groups of duplicate images, only one image has bounding boxes.</p>\n<p><img src=\"https://i.ibb.co/br9Xg6h/results-13-3.png\" alt=\"\"></p>\n<p>In one case, the same image is included in the training set with different bounding boxes marked. </p>\n<p><img src=\"https://i.ibb.co/mvZrVGY/results-13-19.png\" alt=\"\"></p>\n<p>How do you plan on handling the duplicate images? Obviously, duplicate images can be dropped from the dataset. In this case, keep only the ones with bounding boxes?</p>",
      "rawMarkdown": "As others have pointed out, the dataset contains several duplicate images. The following notebook contains all groups of the same or similar images with bounding boxes. I have found 74 groups of similar or the same image.\n\n[siim-covid-19-duplicate-training-images](https://www.kaggle.com/kwk100/siim-covid-19-duplicate-training-images)\n\nIn some groups of duplicate images, only one image has bounding boxes.\n\n![](https://i.ibb.co/br9Xg6h/results-13-3.png)\n\nIn one case, the same image is included in the training set with different bounding boxes marked. \n\n![](https://i.ibb.co/mvZrVGY/results-13-19.png)\n\nHow do you plan on handling the duplicate images? Obviously, duplicate images can be dropped from the dataset. In this case, keep only the ones with bounding boxes?",
      "votes": null
    },
    {
      "id": "1322938",
      "postDate": "05/25/2021 19:59:53",
      "content": "<p>Thanks for pointing out the duplicates and differing bounding boxes.  We are now aware of the duplicates and are investigating different approaches to remedy this issue.  We will follow-up when we arrive at a solution and let you know.</p>",
      "rawMarkdown": "Thanks for pointing out the duplicates and differing bounding boxes.  We are now aware of the duplicates and are investigating different approaches to remedy this issue.  We will follow-up when we arrive at a solution and let you know.",
      "votes": null
    },
    {
      "id": "1323057",
      "postDate": "05/25/2021 23:29:08",
      "content": "<p>Thanks for the update!</p>",
      "rawMarkdown": "Thanks for the update!",
      "votes": null
    },
    {
      "id": "1380299",
      "postDate": "07/08/2021 02:19:24",
      "content": "<p>Hello <a href=\"https://www.kaggle.com/paras42\" target=\"_blank\">@paras42</a>, is there any update on this? Thanks.</p>",
      "rawMarkdown": "Hello @paras42, is there any update on this? Thanks.",
      "votes": null
    },
    {
      "id": "1381216",
      "postDate": "07/08/2021 18:04:46",
      "content": "<p>This was resolved a couple weeks ago: </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/246597\" target=\"_blank\">Here is the thread from the host</a> describing the updates which were made.</li>\n<li><a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/246296\" target=\"_blank\">Here is Kaggle's post</a> that confirms the rescore updates were completed.</li>\n</ul>",
      "rawMarkdown": "This was resolved a couple weeks ago: \n- [Here is the thread from the host](https://www.kaggle.com/c/siim-covid19-detection/discussion/246597) describing the updates which were made.\n- [Here is Kaggle's post](https://www.kaggle.com/c/siim-covid19-detection/discussion/246296) that confirms the rescore updates were completed.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1322938,
      "author_name": "paras42",
      "author_url": "",
      "post_date": "05/25/2021 19:59:53",
      "content": "<p>Thanks for pointing out the duplicates and differing bounding boxes.  We are now aware of the duplicates and are investigating different approaches to remedy this issue.  We will follow-up when we arrive at a solution and let you know.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1323057,
          "author_name": "kwk100",
          "author_url": "",
          "post_date": "05/25/2021 23:29:08",
          "content": "<p>Thanks for the update!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1380299,
          "author_name": "ttavoula",
          "author_url": "",
          "post_date": "07/08/2021 02:19:24",
          "content": "<p>Hello <a href=\"https://www.kaggle.com/paras42\" target=\"_blank\">@paras42</a>, is there any update on this? Thanks.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1381216,
          "author_name": "juliaelliott",
          "author_url": "",
          "post_date": "07/08/2021 18:04:46",
          "content": "<p>This was resolved a couple weeks ago: </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/246597\" target=\"_blank\">Here is the thread from the host</a> describing the updates which were made.</li>\n<li><a href=\"https://www.kaggle.com/c/siim-covid19-detection/discussion/246296\" target=\"_blank\">Here is Kaggle's post</a> that confirms the rescore updates were completed.</li>\n</ul>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1321827": "As others have pointed out, the dataset contains several duplicate images. The following notebook contains all groups of the same or similar images with bounding boxes. I have found 74 groups of similar or the same image.\n\n[siim-covid-19-duplicate-training-images](https://www.kaggle.com/kwk100/siim-covid-19-duplicate-training-images)\n\nIn some groups of duplicate images, only one image has bounding boxes.\n\n![](https://i.ibb.co/br9Xg6h/results-13-3.png)\n\nIn one case, the same image is included in the training set with different bounding boxes marked. \n\n![](https://i.ibb.co/mvZrVGY/results-13-19.png)\n\nHow do you plan on handling the duplicate images? Obviously, duplicate images can be dropped from the dataset. In this case, keep only the ones with bounding boxes?",
    "1322938": "Thanks for pointing out the duplicates and differing bounding boxes.  We are now aware of the duplicates and are investigating different approaches to remedy this issue.  We will follow-up when we arrive at a solution and let you know.",
    "1323057": "Thanks for the update!",
    "1380299": "Hello @paras42, is there any update on this? Thanks.",
    "1381216": "This was resolved a couple weeks ago: \n- [Here is the thread from the host](https://www.kaggle.com/c/siim-covid19-detection/discussion/246597) describing the updates which were made.\n- [Here is Kaggle's post](https://www.kaggle.com/c/siim-covid19-detection/discussion/246296) that confirms the rescore updates were completed."
  },
  "source": "meta"
}