{
  "id": 487806,
  "title": "Exists in train csv but no actual image data. Is this a bug or a specification?",
  "url": "/competitions/image-matching-challenge-2024/discussion/487806",
  "author_name": "YumeNeko",
  "post_date": "2024-03-30T18:01:49.982000",
  "votes": 8,
  "comment_count": 4,
  "views": 0,
  "content": "<p>After checking the Tain data, it seems that in some scenes there are images that exist in train_labels.csv but do not actually exist.<br>\nAnd vice versa (images that exist in the image folder but not in train_labels.csv).</p>\n<p>For example, \"church/images/00036.png\" exists in the image file but not in the csv.<br>\nAlso, \"lizard/images/00574.png\" has information in the csv, but the actual image does not exist.<br>\nHere is <a href=\"https://www.kaggle.com/code/kashiwaba/imc2024-data-check\" target=\"_blank\">the Notebook</a> I used to check.</p>\n<p>Is this a bug? Or is it a specification?</p>",
  "messages": [
    {
      "id": 2724096,
      "postDate": "2024-03-30T18:01:49.983Z",
      "content": "<p>After checking the Tain data, it seems that in some scenes there are images that exist in train_labels.csv but do not actually exist.<br>\nAnd vice versa (images that exist in the image folder but not in train_labels.csv).</p>\n<p>For example, \"church/images/00036.png\" exists in the image file but not in the csv.<br>\nAlso, \"lizard/images/00574.png\" has information in the csv, but the actual image does not exist.<br>\nHere is <a href=\"https://www.kaggle.com/code/kashiwaba/imc2024-data-check\" target=\"_blank\">the Notebook</a> I used to check.</p>\n<p>Is this a bug? Or is it a specification?</p>",
      "rawMarkdown": "After checking the Tain data, it seems that in some scenes there are images that exist in train_labels.csv but do not actually exist.\nAnd vice versa (images that exist in the image folder but not in train_labels.csv).\n\nFor example, \"church/images/00036.png\" exists in the image file but not in the csv.\nAlso, \"lizard/images/00574.png\" has information in the csv, but the actual image does not exist.\nHere is [the Notebook](https://www.kaggle.com/code/kashiwaba/imc2024-data-check) I used to check.\n\nIs this a bug? Or is it a specification?",
      "votes": 8
    },
    {
      "id": 2732777,
      "postDate": "2024-04-03T10:34:41.683Z",
      "content": "<p>Hi,</p>\n<blockquote>\n  <p>Image exists but not in csv</p>\n</blockquote>\n<p>This is not a bug, it is just happened that we have a bit of more images, than were used to get the 3D model, so we added them there. </p>\n<blockquote>\n  <p>information in the csv, but the actual image does not exist.</p>\n</blockquote>\n<p>This is indeed a bug, we are sorry for that, definitely our issue. I don't think that it would make sense to fix it now though.</p>\n<p>Best, orgs. </p>",
      "rawMarkdown": "Hi,\n\n>Image exists but not in csv\n\nThis is not a bug, it is just happened that we have a bit of more images, than were used to get the 3D model, so we added them there. \n\n>information in the csv, but the actual image does not exist.\n\nThis is indeed a bug, we are sorry for that, definitely our issue. I don't think that it would make sense to fix it now though.\n\nBest, orgs. \n",
      "votes": 2,
      "replies": [
        {
          "id": 2733466,
          "postDate": "2024-04-03T16:28:36.670Z",
          "content": "<p>Plus: if you visually inspect the folder for <code>multi-temporal-temple-baalshamin</code> you can find that there were conversion problems, e.g. <code>temle-ba'al-shamin-4</code>  &lt;--&gt;  <code>temle-ba_al-shamin-4</code> (<code>'</code> became `_').</p>",
          "rawMarkdown": "Plus: if you visually inspect the folder for `multi-temporal-temple-baalshamin` you can find that there were conversion problems, e.g. `temle-ba'al-shamin-4`  <-->  `temle-ba_al-shamin-4` (`'` became `_').",
          "votes": 5
        },
        {
          "id": 2749872,
          "postDate": "2024-04-13T10:19:49.863Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 2771848,
          "postDate": "2024-04-24T12:31:51.790Z",
          "content": "<p>Also note that some image names &amp; Ground Truth Data (of some datasets) are repeated in train_labels.csv. For example, In 'multi-temporal-temple-baalshamin' dataset, 'temple_of_ba_al_shamin_palmyra_syria.png' (row 80, 82), 'temle_ba_al_shamin_4.png' (row 140, 141) are few among repeated in train_labels.csv.</p>\n<p>So kindly be careful while sampling from train_labels.csv</p>",
          "rawMarkdown": "Also note that some image names & Ground Truth Data (of some datasets) are repeated in train_labels.csv. For example, In 'multi-temporal-temple-baalshamin' dataset, 'temple_of_ba_al_shamin_palmyra_syria.png' (row 80, 82), 'temle_ba_al_shamin_4.png' (row 140, 141) are few among repeated in train_labels.csv.\n\nSo kindly be careful while sampling from train_labels.csv",
          "isDeleted": true
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2732777,
      "author_name": "old-ufo",
      "author_url": "",
      "post_date": "2024-04-03T10:34:41.683000",
      "content": "<p>Hi,</p>\n<blockquote>\n  <p>Image exists but not in csv</p>\n</blockquote>\n<p>This is not a bug, it is just happened that we have a bit of more images, than were used to get the 3D model, so we added them there. </p>\n<blockquote>\n  <p>information in the csv, but the actual image does not exist.</p>\n</blockquote>\n<p>This is indeed a bug, we are sorry for that, definitely our issue. I don't think that it would make sense to fix it now though.</p>\n<p>Best, orgs. </p>",
      "votes": 2,
      "replies": [
        {
          "id": 2733466,
          "author_name": "WastedCode",
          "author_url": "",
          "post_date": "2024-04-03T16:28:36.670000",
          "content": "<p>Plus: if you visually inspect the folder for <code>multi-temporal-temple-baalshamin</code> you can find that there were conversion problems, e.g. <code>temle-ba'al-shamin-4</code>  &lt;--&gt;  <code>temle-ba_al-shamin-4</code> (<code>'</code> became `_').</p>",
          "votes": 5,
          "replies": []
        },
        {
          "id": 2749872,
          "author_name": "",
          "author_url": "",
          "post_date": "2024-04-13T10:19:49.863000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 2771848,
          "author_name": "",
          "author_url": "",
          "post_date": "2024-04-24T12:31:51.790000",
          "content": "<p>Also note that some image names &amp; Ground Truth Data (of some datasets) are repeated in train_labels.csv. For example, In 'multi-temporal-temple-baalshamin' dataset, 'temple_of_ba_al_shamin_palmyra_syria.png' (row 80, 82), 'temle_ba_al_shamin_4.png' (row 140, 141) are few among repeated in train_labels.csv.</p>\n<p>So kindly be careful while sampling from train_labels.csv</p>",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2724096": "After checking the Tain data, it seems that in some scenes there are images that exist in train_labels.csv but do not actually exist.\nAnd vice versa (images that exist in the image folder but not in train_labels.csv).\n\nFor example, \"church/images/00036.png\" exists in the image file but not in the csv.\nAlso, \"lizard/images/00574.png\" has information in the csv, but the actual image does not exist.\nHere is [the Notebook](https://www.kaggle.com/code/kashiwaba/imc2024-data-check) I used to check.\n\nIs this a bug? Or is it a specification?",
    "2732777": "Hi,\n\n>Image exists but not in csv\n\nThis is not a bug, it is just happened that we have a bit of more images, than were used to get the 3D model, so we added them there. \n\n>information in the csv, but the actual image does not exist.\n\nThis is indeed a bug, we are sorry for that, definitely our issue. I don't think that it would make sense to fix it now though.\n\nBest, orgs. \n"
  }
}