{
  "id": 579064,
  "title": "My submission gives me an invalid submission error",
  "url": "/competitions/image-matching-challenge-2025/discussion/579064",
  "author_name": "",
  "post_date": "2025-05-14T23:09:46.251928500Z",
  "votes": 4,
  "comment_count": 5,
  "views": 0,
  "content": "<p>My submission files were being scored as intended but suddenly I started receiving the error:</p>\n<blockquote>\n  <p>Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.</p>\n</blockquote>\n<p>I have compared my non_working submission files multiple times with the working ones and I do not seem to be able to find the underlying issue.</p>\n<p>I have attached two of my non working files.</p>\n<p>I renamed the files for me to differentiate but when submitting to the competition I had only submission.csv as it's name.</p>\n<p>I hope someone can help me identify what's causing the error.</p>",
  "messages": [
    {
      "id": "3202141",
      "postDate": "05/14/2025 23:09:46",
      "content": "<p>My submission files were being scored as intended but suddenly I started receiving the error:</p>\n<blockquote>\n  <p>Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.</p>\n</blockquote>\n<p>I have compared my non_working submission files multiple times with the working ones and I do not seem to be able to find the underlying issue.</p>\n<p>I have attached two of my non working files.</p>\n<p>I renamed the files for me to differentiate but when submitting to the competition I had only submission.csv as it's name.</p>\n<p>I hope someone can help me identify what's causing the error.</p>",
      "rawMarkdown": "My submission files were being scored as intended but suddenly I started receiving the error:\n\n>Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.\n\nI have compared my non_working submission files multiple times with the working ones and I do not seem to be able to find the underlying issue.\n\nI have attached two of my non working files.\n\nI renamed the files for me to differentiate but when submitting to the competition I had only submission.csv as it's name.\n\nI hope someone can help me identify what's causing the error.",
      "votes": null
    },
    {
      "id": "3202930",
      "postDate": "05/16/2025 06:09:51",
      "content": "<p>the file don't includes all the datasets, it only has ETs and stairs. Try to use codes from this link: <a href=\"https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue\" target=\"_blank\">https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue</a>, to update your submission.csv</p>",
      "rawMarkdown": "the file don't includes all the datasets, it only has ETs and stairs. Try to use codes from this link: https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue, to update your submission.csv",
      "votes": null
    },
    {
      "id": "3202949",
      "postDate": "05/16/2025 06:34:32",
      "content": "<p>I have made some submissions previously with only ETs and stairs, I was still getting scores for it. But I will give this a try! Thank you.</p>\n<p>Also, do you know why whenever I submit, my notebook finishes running in 1-2 hours but the \"scoring\" part goes till notebook timeout. Does the notebook run on a hidden test set?</p>",
      "rawMarkdown": "I have made some submissions previously with only ETs and stairs, I was still getting scores for it. But I will give this a try! Thank you.\n\nAlso, do you know why whenever I submit, my notebook finishes running in 1-2 hours but the \"scoring\" part goes till notebook timeout. Does the notebook run on a hidden test set?",
      "votes": null
    },
    {
      "id": "3203775",
      "postDate": "05/17/2025 09:42:07",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/lilpegasus\" target=\"_blank\">@lilpegasus</a> , thank you for sharing this topic!</p>\n<p>In the last few days, I have also encountered submission scoring error in some of my submissions.<br>\n(Although some submissions do complete successfully)<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4671348%2Fb85561a6314b22bb9d1bfddbad4457e1%2Fsubmission_error.png?generation=1747474541582294&amp;alt=media\" alt=\"\"><br>\nThis submission error also occurs with minor changes such as parameter updates,<br>\nso I don’t think it’s likely that the format of my submission.csv is broken.<br>\nAlso, since this competition’s metric seems to be supposed to handle infinite values,<br>\nI assume it’s not a scoring failure caused by invalid score values.</p>\n<p>While investigating the possible causes of the scoring error,<br>\nI found this post that mentions a time limit of the scoring phase.<br>\n<a href=\"https://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969\" target=\"_blank\">https://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969</a></p>\n<p>As this competition's scoring seems to take relatively long,<br>\nI’m wondering if the scoring process may be exceeding the time limit in some of my submissions.</p>\n<p>I'm curious if anyone has encountered the same issue.<br>\nAlso <a href=\"https://www.kaggle.com/eduardtrulls\" target=\"_blank\">@eduardtrulls</a> <a href=\"https://www.kaggle.com/oldufo\" target=\"_blank\">@oldufo</a> , is there a time limit for the scoring phase in this competition?<br>\nIf you could, I would appreciate your response about this point.</p>",
      "rawMarkdown": "Hi @lilpegasus , thank you for sharing this topic!\n\nIn the last few days, I have also encountered submission scoring error in some of my submissions.\n(Although some submissions do complete successfully)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4671348%2Fb85561a6314b22bb9d1bfddbad4457e1%2Fsubmission_error.png?generation=1747474541582294&alt=media)\nThis submission error also occurs with minor changes such as parameter updates,\nso I don’t think it’s likely that the format of my submission.csv is broken.\nAlso, since this competition’s metric seems to be supposed to handle infinite values,\nI assume it’s not a scoring failure caused by invalid score values.\n\nWhile investigating the possible causes of the scoring error,\nI found this post that mentions a time limit of the scoring phase.\nhttps://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969\n\nAs this competition's scoring seems to take relatively long,\nI’m wondering if the scoring process may be exceeding the time limit in some of my submissions.\n\nI'm curious if anyone has encountered the same issue.\nAlso @eduardtrulls @oldufo , is there a time limit for the scoring phase in this competition?\nIf you could, I would appreciate your response about this point.",
      "votes": null
    },
    {
      "id": "3205560",
      "postDate": "05/20/2025 05:39:27",
      "content": "<p>Yes, you are right.  It's quite normal.</p>",
      "rawMarkdown": "Yes, you are right.  It's quite normal.",
      "votes": null
    },
    {
      "id": "3206714",
      "postDate": "05/21/2025 17:40:34",
      "content": "<p>thank you </p>",
      "rawMarkdown": "thank you",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3202930,
      "author_name": "yuanlin08",
      "author_url": "",
      "post_date": "05/16/2025 06:09:51",
      "content": "<p>the file don't includes all the datasets, it only has ETs and stairs. Try to use codes from this link: <a href=\"https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue\" target=\"_blank\">https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue</a>, to update your submission.csv</p>",
      "votes": null,
      "replies": [
        {
          "id": 3202949,
          "author_name": "lilpegasus",
          "author_url": "",
          "post_date": "05/16/2025 06:34:32",
          "content": "<p>I have made some submissions previously with only ETs and stairs, I was still getting scores for it. But I will give this a try! Thank you.</p>\n<p>Also, do you know why whenever I submit, my notebook finishes running in 1-2 hours but the \"scoring\" part goes till notebook timeout. Does the notebook run on a hidden test set?</p>",
          "votes": null,
          "replies": [
            {
              "id": 3205560,
              "author_name": "yuanlin08",
              "author_url": "",
              "post_date": "05/20/2025 05:39:27",
              "content": "<p>Yes, you are right.  It's quite normal.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3203775,
      "author_name": "ryosukesaito",
      "author_url": "",
      "post_date": "05/17/2025 09:42:07",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/lilpegasus\" target=\"_blank\">@lilpegasus</a> , thank you for sharing this topic!</p>\n<p>In the last few days, I have also encountered submission scoring error in some of my submissions.<br>\n(Although some submissions do complete successfully)<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4671348%2Fb85561a6314b22bb9d1bfddbad4457e1%2Fsubmission_error.png?generation=1747474541582294&amp;alt=media\" alt=\"\"><br>\nThis submission error also occurs with minor changes such as parameter updates,<br>\nso I don’t think it’s likely that the format of my submission.csv is broken.<br>\nAlso, since this competition’s metric seems to be supposed to handle infinite values,<br>\nI assume it’s not a scoring failure caused by invalid score values.</p>\n<p>While investigating the possible causes of the scoring error,<br>\nI found this post that mentions a time limit of the scoring phase.<br>\n<a href=\"https://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969\" target=\"_blank\">https://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969</a></p>\n<p>As this competition's scoring seems to take relatively long,<br>\nI’m wondering if the scoring process may be exceeding the time limit in some of my submissions.</p>\n<p>I'm curious if anyone has encountered the same issue.<br>\nAlso <a href=\"https://www.kaggle.com/eduardtrulls\" target=\"_blank\">@eduardtrulls</a> <a href=\"https://www.kaggle.com/oldufo\" target=\"_blank\">@oldufo</a> , is there a time limit for the scoring phase in this competition?<br>\nIf you could, I would appreciate your response about this point.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3206714,
      "author_name": "",
      "author_url": "",
      "post_date": "05/21/2025 17:40:34",
      "content": "<p>thank you </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3202141": "My submission files were being scored as intended but suddenly I started receiving the error:\n\n>Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.\n\nI have compared my non_working submission files multiple times with the working ones and I do not seem to be able to find the underlying issue.\n\nI have attached two of my non working files.\n\nI renamed the files for me to differentiate but when submitting to the competition I had only submission.csv as it's name.\n\nI hope someone can help me identify what's causing the error.",
    "3202930": "the file don't includes all the datasets, it only has ETs and stairs. Try to use codes from this link: https://www.kaggle.com/code/octaviograu/baseline-dinov2-aliked-lightglue, to update your submission.csv",
    "3202949": "I have made some submissions previously with only ETs and stairs, I was still getting scores for it. But I will give this a try! Thank you.\n\nAlso, do you know why whenever I submit, my notebook finishes running in 1-2 hours but the \"scoring\" part goes till notebook timeout. Does the notebook run on a hidden test set?",
    "3203775": "Hi @lilpegasus , thank you for sharing this topic!\n\nIn the last few days, I have also encountered submission scoring error in some of my submissions.\n(Although some submissions do complete successfully)\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4671348%2Fb85561a6314b22bb9d1bfddbad4457e1%2Fsubmission_error.png?generation=1747474541582294&alt=media)\nThis submission error also occurs with minor changes such as parameter updates,\nso I don’t think it’s likely that the format of my submission.csv is broken.\nAlso, since this competition’s metric seems to be supposed to handle infinite values,\nI assume it’s not a scoring failure caused by invalid score values.\n\nWhile investigating the possible causes of the scoring error,\nI found this post that mentions a time limit of the scoring phase.\nhttps://www.kaggle.com/competitions/blood-vessel-segmentation/discussion/459969\n\nAs this competition's scoring seems to take relatively long,\nI’m wondering if the scoring process may be exceeding the time limit in some of my submissions.\n\nI'm curious if anyone has encountered the same issue.\nAlso @eduardtrulls @oldufo , is there a time limit for the scoring phase in this competition?\nIf you could, I would appreciate your response about this point.",
    "3205560": "Yes, you are right.  It's quite normal.",
    "3206714": "thank you"
  },
  "source": "meta"
}