{
  "id": 614886,
  "title": "Discrepancy in `jd_sherds_info.csv` File Size and Duplicate IDs**",
  "url": "/competitions/h690/discussion/614886",
  "author_name": "LazyUnicorn",
  "post_date": "2025-11-07T08:37:31.827000",
  "votes": 3,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hello Organizers and fellow participants,</p>\n<p>I am reporting a critical data integrity issue identified during the final submission generation, which prevents creating a file with the required 35,159 unique fragment IDs.</p>\n<ol>\n<li>Data Analysis Findings</li>\n</ol>\n<p>Upon inspecting the official reference file provided in the dataset, /kaggle/input/h690/h690/h690/jd_sherds_info.csv, the following discrepancy was found:</p>\n<p>Total rows in the source file: 35,375</p>\n<p>Expected unique rows for final submission: 35,159</p>\n<ol>\n<li>Duplicate Correction Analysis</li>\n</ol>\n<p>My code identified one single duplicate ID: JD05253_1_exterior (appearing 2 times).</p>\n<p>After correcting this one duplicate, the file size becomes 35,374 unique fragment IDs.</p>\n<ol>\n<li>The Unresolved Gap</li>\n</ol>\n<p>Even with the duplicate corrected, the file size is still too large: 35,374 - 35,159 = 215 rows.</p>\n<p>This means the jd_sherds_info.csv file contains 215 fragment IDs that are not expected by the competition's submission system.</p>\n<p>Request for Clarification</p>\n<p>Could the organizers please confirm which 215 fragment IDs from the current jd_sherds_info.csv file should be excluded to match the required 35,159 entries?</p>\n<p>Resolving this is crucial to produce a valid submission file that the evaluation system will accept. Thank you for your urgent assistance.</p>",
  "messages": [
    {
      "id": 3340058,
      "postDate": "2025-11-19T11:33:07.187Z",
      "content": "<p><a href=\"https://www.kaggle.com/samvelkoch\" target=\"_blank\">@samvelkoch</a> <a href=\"https://www.kaggle.com/ch272h\" target=\"_blank\">@ch272h</a> <a href=\"https://www.kaggle.com/sarznn\" target=\"_blank\">@sarznn</a> Hi all,</p>\n<p>The attached file contains all the image IDs you need. Just fill in the \"Assembly Group\" field.</p>\n<p>Since you also need to include the final assembled image, please send everything to our email. <a href=\"mailto:h690@uic.edu.cn\">h690@uic.edu.cn</a></p>",
      "rawMarkdown": "@samvelkoch @ch272h @sarznn Hi all,\n\nThe attached file contains all the image IDs you need. Just fill in the \"Assembly Group\" field.\n\nSince you also need to include the final assembled image, please send everything to our email. h690@uic.edu.cn",
      "votes": 3,
      "replies": [
        {
          "id": 3340070,
          "postDate": "2025-11-19T11:39:27.207Z",
          "content": "<p>Thank you 🙏 <a href=\"https://www.kaggle.com/qiupenggeng\" target=\"_blank\">@qiupenggeng</a> </p>",
          "rawMarkdown": "Thank you 🙏 @qiupenggeng ",
          "votes": 1
        }
      ]
    },
    {
      "id": 3312459,
      "postDate": "2025-11-07T08:37:31.827Z",
      "content": "<p>Hello Organizers and fellow participants,</p>\n<p>I am reporting a critical data integrity issue identified during the final submission generation, which prevents creating a file with the required 35,159 unique fragment IDs.</p>\n<ol>\n<li>Data Analysis Findings</li>\n</ol>\n<p>Upon inspecting the official reference file provided in the dataset, /kaggle/input/h690/h690/h690/jd_sherds_info.csv, the following discrepancy was found:</p>\n<p>Total rows in the source file: 35,375</p>\n<p>Expected unique rows for final submission: 35,159</p>\n<ol>\n<li>Duplicate Correction Analysis</li>\n</ol>\n<p>My code identified one single duplicate ID: JD05253_1_exterior (appearing 2 times).</p>\n<p>After correcting this one duplicate, the file size becomes 35,374 unique fragment IDs.</p>\n<ol>\n<li>The Unresolved Gap</li>\n</ol>\n<p>Even with the duplicate corrected, the file size is still too large: 35,374 - 35,159 = 215 rows.</p>\n<p>This means the jd_sherds_info.csv file contains 215 fragment IDs that are not expected by the competition's submission system.</p>\n<p>Request for Clarification</p>\n<p>Could the organizers please confirm which 215 fragment IDs from the current jd_sherds_info.csv file should be excluded to match the required 35,159 entries?</p>\n<p>Resolving this is crucial to produce a valid submission file that the evaluation system will accept. Thank you for your urgent assistance.</p>",
      "rawMarkdown": "Hello Organizers and fellow participants,\n\nI am reporting a critical data integrity issue identified during the final submission generation, which prevents creating a file with the required 35,159 unique fragment IDs.\n\n1. Data Analysis Findings\n\nUpon inspecting the official reference file provided in the dataset, /kaggle/input/h690/h690/h690/jd_sherds_info.csv, the following discrepancy was found:\n\nTotal rows in the source file: 35,375\n\nExpected unique rows for final submission: 35,159\n\n2. Duplicate Correction Analysis\n\nMy code identified one single duplicate ID: JD05253_1_exterior (appearing 2 times).\n\nAfter correcting this one duplicate, the file size becomes 35,374 unique fragment IDs.\n\n3. The Unresolved Gap\n\nEven with the duplicate corrected, the file size is still too large: 35,374 - 35,159 = 215 rows.\n\nThis means the jd_sherds_info.csv file contains 215 fragment IDs that are not expected by the competition's submission system.\n\nRequest for Clarification\n\nCould the organizers please confirm which 215 fragment IDs from the current jd_sherds_info.csv file should be excluded to match the required 35,159 entries?\n\nResolving this is crucial to produce a valid submission file that the evaluation system will accept. Thank you for your urgent assistance.",
      "votes": 3
    },
    {
      "id": 3323337,
      "postDate": "2025-11-14T06:05:36.797Z",
      "content": "<p>Your submission should include 35,159 records. Please ignore the jd_sherds_info.csv file.</p>",
      "rawMarkdown": "Your submission should include 35,159 records. Please ignore the jd_sherds_info.csv file.",
      "replies": [
        {
          "id": 3323622,
          "postDate": "2025-11-14T10:56:59.497Z",
          "content": "<p>Dear <a href=\"https://www.kaggle.com/qiupenggeng\" target=\"_blank\">@qiupenggeng</a>. Could you please share dummy_submission.csv which will be accepted as correct submission?</p>\n<p>We got this error for submissions shaped (35159, 2):</p>\n<p><code>Solution and submission values for image_id do not match</code></p>",
          "rawMarkdown": "Dear @qiupenggeng. Could you please share dummy_submission.csv which will be accepted as correct submission?\n\nWe got this error for submissions shaped (35159, 2):\n\n`Solution and submission values for image_id do not match`",
          "replies": [
            {
              "id": 3323769,
              "postDate": "2025-11-14T13:19:10.340Z",
              "content": "<p>Same Error</p>",
              "rawMarkdown": "Same Error"
            }
          ]
        }
      ]
    },
    {
      "id": 3322954,
      "postDate": "2025-11-13T21:59:17.740Z",
      "content": "<p>There are 35,159 images in the sherd_images directory. However not all of the image names appear in jd_sherds_info.csv, which is also confusing.</p>",
      "rawMarkdown": "There are 35,159 images in the sherd_images directory. However not all of the image names appear in jd_sherds_info.csv, which is also confusing."
    },
    {
      "id": 3320554,
      "postDate": "2025-11-12T16:04:01.447Z",
      "content": "<p>I have the same confusion.</p>",
      "rawMarkdown": "I have the same confusion."
    },
    {
      "id": 3322955,
      "postDate": "2025-11-13T22:00:53.090Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3340058,
      "author_name": "qiupeng geng",
      "author_url": "",
      "post_date": "2025-11-19T11:33:07.187000",
      "content": "<p><a href=\"https://www.kaggle.com/samvelkoch\" target=\"_blank\">@samvelkoch</a> <a href=\"https://www.kaggle.com/ch272h\" target=\"_blank\">@ch272h</a> <a href=\"https://www.kaggle.com/sarznn\" target=\"_blank\">@sarznn</a> Hi all,</p>\n<p>The attached file contains all the image IDs you need. Just fill in the \"Assembly Group\" field.</p>\n<p>Since you also need to include the final assembled image, please send everything to our email. <a href=\"mailto:h690@uic.edu.cn\">h690@uic.edu.cn</a></p>",
      "votes": 3,
      "replies": [
        {
          "id": 3340070,
          "author_name": "Samvel Kocharyan",
          "author_url": "",
          "post_date": "2025-11-19T11:39:27.207000",
          "content": "<p>Thank you 🙏 <a href=\"https://www.kaggle.com/qiupenggeng\" target=\"_blank\">@qiupenggeng</a> </p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 3323337,
      "author_name": "qiupeng geng",
      "author_url": "",
      "post_date": "2025-11-14T06:05:36.797000",
      "content": "<p>Your submission should include 35,159 records. Please ignore the jd_sherds_info.csv file.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3323622,
          "author_name": "Samvel Kocharyan",
          "author_url": "",
          "post_date": "2025-11-14T10:56:59.497000",
          "content": "<p>Dear <a href=\"https://www.kaggle.com/qiupenggeng\" target=\"_blank\">@qiupenggeng</a>. Could you please share dummy_submission.csv which will be accepted as correct submission?</p>\n<p>We got this error for submissions shaped (35159, 2):</p>\n<p><code>Solution and submission values for image_id do not match</code></p>",
          "votes": 0,
          "replies": [
            {
              "id": 3323769,
              "author_name": "techtech69",
              "author_url": "",
              "post_date": "2025-11-14T13:19:10.340000",
              "content": "<p>Same Error</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3322954,
      "author_name": "ch272h",
      "author_url": "",
      "post_date": "2025-11-13T21:59:17.740000",
      "content": "<p>There are 35,159 images in the sherd_images directory. However not all of the image names appear in jd_sherds_info.csv, which is also confusing.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3320554,
      "author_name": "Sarznn",
      "author_url": "",
      "post_date": "2025-11-12T16:04:01.447000",
      "content": "<p>I have the same confusion.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3322955,
      "author_name": "",
      "author_url": "",
      "post_date": "2025-11-13T22:00:53.090000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3340058": "@samvelkoch @ch272h @sarznn Hi all,\n\nThe attached file contains all the image IDs you need. Just fill in the \"Assembly Group\" field.\n\nSince you also need to include the final assembled image, please send everything to our email. h690@uic.edu.cn",
    "3312459": "Hello Organizers and fellow participants,\n\nI am reporting a critical data integrity issue identified during the final submission generation, which prevents creating a file with the required 35,159 unique fragment IDs.\n\n1. Data Analysis Findings\n\nUpon inspecting the official reference file provided in the dataset, /kaggle/input/h690/h690/h690/jd_sherds_info.csv, the following discrepancy was found:\n\nTotal rows in the source file: 35,375\n\nExpected unique rows for final submission: 35,159\n\n2. Duplicate Correction Analysis\n\nMy code identified one single duplicate ID: JD05253_1_exterior (appearing 2 times).\n\nAfter correcting this one duplicate, the file size becomes 35,374 unique fragment IDs.\n\n3. The Unresolved Gap\n\nEven with the duplicate corrected, the file size is still too large: 35,374 - 35,159 = 215 rows.\n\nThis means the jd_sherds_info.csv file contains 215 fragment IDs that are not expected by the competition's submission system.\n\nRequest for Clarification\n\nCould the organizers please confirm which 215 fragment IDs from the current jd_sherds_info.csv file should be excluded to match the required 35,159 entries?\n\nResolving this is crucial to produce a valid submission file that the evaluation system will accept. Thank you for your urgent assistance.",
    "3323337": "Your submission should include 35,159 records. Please ignore the jd_sherds_info.csv file.",
    "3322954": "There are 35,159 images in the sherd_images directory. However not all of the image names appear in jd_sherds_info.csv, which is also confusing.",
    "3320554": "I have the same confusion.",
    "3322955": ""
  }
}