{
  "id": 636548,
  "title": "Submission failures?",
  "url": "/competitions/vesuvius-challenge-surface-detection/discussion/636548",
  "author_name": "Satwik",
  "post_date": "2025-11-21T12:21:35.629000",
  "votes": 5,
  "comment_count": 24,
  "views": 0,
  "content": "<p>Hi , we made 3 submissions today and all have failed, two with Submission Scoring Error, and one of them had Kaggle Error. We used the exact same notebook that worked before, with just different models.</p>\n<p>Is anyone else facing similar issues?</p>",
  "messages": [
    {
      "id": 3393603,
      "postDate": "2026-01-19T11:45:54.033Z",
      "content": "<p>I used the official evaluation code locally to assess the effectiveness of some post-processing methods, and the local results looked quite promising. However, after submitting to the Public Leaderboard, I initially received a \"Kaggle Error.\"</p>\n<p>About 30 minutes later, the error automatically disappeared, and a score was calculated. However, this score was at least 2-3% lower than my previous results (or lower than expected).</p>\n<p>I am not sure if the drop in score is related to this Kaggle Error, or if our methods simply failed to generalize. Regardless, the appearance of the Kaggle Error was quite strange.</p>\n<p>I was wondering if anyone else experienced the same situation with their scores?</p>",
      "rawMarkdown": "I used the official evaluation code locally to assess the effectiveness of some post-processing methods, and the local results looked quite promising. However, after submitting to the Public Leaderboard, I initially received a \"Kaggle Error.\"\n\nAbout 30 minutes later, the error automatically disappeared, and a score was calculated. However, this score was at least 2-3% lower than my previous results (or lower than expected).\n\nI am not sure if the drop in score is related to this Kaggle Error, or if our methods simply failed to generalize. Regardless, the appearance of the Kaggle Error was quite strange.\n\n I was wondering if anyone else experienced the same situation with their scores?",
      "votes": 1
    },
    {
      "id": 3343108,
      "postDate": "2025-11-21T12:21:35.630Z",
      "content": "<p>Hi , we made 3 submissions today and all have failed, two with Submission Scoring Error, and one of them had Kaggle Error. We used the exact same notebook that worked before, with just different models.</p>\n<p>Is anyone else facing similar issues?</p>",
      "rawMarkdown": "Hi , we made 3 submissions today and all have failed, two with Submission Scoring Error, and one of them had Kaggle Error. We used the exact same notebook that worked before, with just different models.\n\nIs anyone else facing similar issues?",
      "votes": 5
    },
    {
      "id": 3354510,
      "postDate": "2025-11-30T10:37:49.110Z",
      "content": "<p>so basically every time we submit it will take 9 hours to process then another 1 hour to resolve whatever that kaggle error is ? I have submitted 4 times and each time it took 10 hours to submit</p>",
      "rawMarkdown": "so basically every time we submit it will take 9 hours to process then another 1 hour to resolve whatever that kaggle error is ? I have submitted 4 times and each time it took 10 hours to submit",
      "votes": 1,
      "replies": [
        {
          "id": 3354523,
          "postDate": "2025-11-30T10:44:22.383Z",
          "content": "<p>Not sure why it takes that long for you. Most of my submissions take ~2 hours to run , and ~3 hours to score. </p>",
          "rawMarkdown": "Not sure why it takes that long for you. Most of my submissions take ~2 hours to run , and ~3 hours to score. ",
          "votes": 3
        }
      ]
    },
    {
      "id": 3351420,
      "postDate": "2025-11-28T11:58:06.983Z",
      "content": "<p>I did face something similar at the beginning until I realised that annotation has three classes but prediction has to be only binary 1/0 and with the same volume dimension and data-type as uint8…\nThere is how I handle the third class for training and ensure correct format for submission: <a href=\"https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation\" target=\"_blank\">https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation</a></p>",
      "rawMarkdown": "I did face something similar at the beginning until I realised that annotation has three classes but prediction has to be only binary 1/0 and with the same volume dimension and data-type as uint8...\nThere is how I handle the third class for training and ensure correct format for submission: https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation",
      "votes": 2
    },
    {
      "id": 3405505,
      "postDate": "2026-02-13T08:41:52.227Z",
      "content": "<p>I am facing Submission scoring error.\nwhere sometimes i just changed the model.\nOne time changing the model, doesn't caused error, but other time it happened.\nThis type of errors are too shit, i also added assert checks to see if some issue in internal runs, but the submission mask's dtype or values are what expected unit8:0,1 . throwed only submission scoring error.</p>\n<p>This is really annoying.</p>",
      "rawMarkdown": "I am facing Submission scoring error.\nwhere sometimes i just changed the model.\nOne time changing the model, doesn't caused error, but other time it happened.\nThis type of errors are too shit, i also added assert checks to see if some issue in internal runs, but the submission mask's dtype or values are what expected unit8:0,1 . throwed only submission scoring error.\n\nThis is really annoying."
    },
    {
      "id": 3402440,
      "postDate": "2026-02-06T04:30:57.270Z",
      "content": "<p>Getting Kaggle Error in 12th hr from submission then on 13th hr getting Submission Scoring Error. Used the same predict function which worked before and also did validation with the output using competition metric in local. Is there any specific change that worked for you <a href=\"https://www.kaggle.com/p4rallax\" target=\"_blank\">@p4rallax</a> ?</p>",
      "rawMarkdown": "Getting Kaggle Error in 12th hr from submission then on 13th hr getting Submission Scoring Error. Used the same predict function which worked before and also did validation with the output using competition metric in local. Is there any specific change that worked for you @p4rallax ?",
      "replies": [
        {
          "id": 3402567,
          "postDate": "2026-02-06T10:26:46.017Z",
          "content": "<p>Nope , I made no changes, it was resolved on its own after a while.</p>",
          "rawMarkdown": "Nope , I made no changes, it was resolved on its own after a while.",
          "votes": 1,
          "replies": [
            {
              "id": 3402569,
              "postDate": "2026-02-06T10:30:44.340Z",
              "rawMarkdown": "",
              "isDeleted": true
            }
          ]
        }
      ]
    },
    {
      "id": 3399323,
      "postDate": "2026-01-30T16:37:46.417Z",
      "content": "<p>im facing the same issues</p>",
      "rawMarkdown": "im facing the same issues"
    },
    {
      "id": 3399301,
      "postDate": "2026-01-30T15:58:31.223Z",
      "content": "<p>Anyone getting imagecodecs error? We need to submit the notebook offline, but the package doesn't exists in Kaggle runtimes. So I tried to add it as a dataset and add to my notebook but still errors and I've wasted my daily submissions to these bugs :(</p>",
      "rawMarkdown": "Anyone getting imagecodecs error? We need to submit the notebook offline, but the package doesn't exists in Kaggle runtimes. So I tried to add it as a dataset and add to my notebook but still errors and I've wasted my daily submissions to these bugs :(",
      "replies": [
        {
          "id": 3399368,
          "postDate": "2026-01-30T18:28:21.120Z",
          "content": "<p>On top of the notebook editor, you'll see Add-ons. click on it and click on Install Dependencies. Then add this to packages: pip install imagecodecs, and click save. It will install without turning the internet on.</p>",
          "rawMarkdown": "On top of the notebook editor, you'll see Add-ons. click on it and click on Install Dependencies. Then add this to packages: pip install imagecodecs, and click save. It will install without turning the internet on.\n"
        }
      ]
    },
    {
      "id": 3391079,
      "postDate": "2026-01-14T11:17:41.317Z",
      "content": "<p>I'm encountering kaggle error on a repeated basis on submission. The process takes around 4+ hours and I end up with a kaggle error. Is anyone still facing issues with errors on submission?</p>",
      "rawMarkdown": "I'm encountering kaggle error on a repeated basis on submission. The process takes around 4+ hours and I end up with a kaggle error. Is anyone still facing issues with errors on submission?",
      "replies": [
        {
          "id": 3391090,
          "postDate": "2026-01-14T11:35:46.303Z",
          "content": "<p>We had Kaggle Error issue too , but it resolved itself eventually. If it doesn't for you, you will probably have to debug your notebook and check for any exceptions</p>",
          "rawMarkdown": "We had Kaggle Error issue too , but it resolved itself eventually. If it doesn't for you, you will probably have to debug your notebook and check for any exceptions",
          "replies": [
            {
              "id": 3391124,
              "postDate": "2026-01-14T12:46:20.333Z",
              "content": "<p>Okay so one of the submissions worked out somehow. Very confusing! </p>",
              "rawMarkdown": "Okay so one of the submissions worked out somehow. Very confusing! "
            }
          ]
        }
      ]
    },
    {
      "id": 3386467,
      "postDate": "2026-01-05T10:26:49.797Z",
      "content": "<p>This also happened to me; it appeared as \"Kaggle error\" then \"Submission error.\" Have you found the solution yet?</p>",
      "rawMarkdown": "This also happened to me; it appeared as \"Kaggle error\" then \"Submission error.\" Have you found the solution yet?",
      "replies": [
        {
          "id": 3386521,
          "postDate": "2026-01-05T12:54:40.827Z",
          "content": "<p>Just reload a few time and your score will appear</p>",
          "rawMarkdown": "Just reload a few time and your score will appear"
        },
        {
          "id": 3402428,
          "postDate": "2026-02-06T04:01:59.997Z",
          "rawMarkdown": "",
          "isDeleted": true
        }
      ]
    },
    {
      "id": 3364597,
      "postDate": "2025-12-06T15:22:39.143Z",
      "content": "<p>Why so many kaggle errors <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> ? Is there's something on the participant's end which is making these kaggle errors common , or on kaggle's side.\nThe problem with kaggle error is that you get an error and you don't even know which direction to proceed to.</p>",
      "rawMarkdown": "Why so many kaggle errors @sohier ? Is there's something on the participant's end which is making these kaggle errors common , or on kaggle's side.\nThe problem with kaggle error is that you get an error and you don't even know which direction to proceed to.",
      "replies": [
        {
          "id": 3364674,
          "postDate": "2025-12-06T16:11:19.787Z",
          "content": "<p>My submission showed kaggle error, and now suddenly it showed submission complete.</p>",
          "rawMarkdown": "My submission showed kaggle error, and now suddenly it showed submission complete.",
          "replies": [
            {
              "id": 3365010,
              "postDate": "2025-12-06T21:24:24.460Z",
              "content": "<p>Happened to me also, just re-submit helped… </p>",
              "rawMarkdown": "Happened to me also, just re-submit helped... "
            }
          ]
        }
      ]
    },
    {
      "id": 3343862,
      "postDate": "2025-11-22T05:24:35.023Z",
      "content": "<p>tag <a href=\"https://www.kaggle.com/giorgioangelotti\" target=\"_blank\">@giorgioangelotti</a>  <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> for help</p>",
      "rawMarkdown": "tag @giorgioangelotti  @sohier for help"
    },
    {
      "id": 3343481,
      "postDate": "2025-11-21T17:29:46.870Z",
      "content": "<p>same here </p>",
      "rawMarkdown": "same here "
    },
    {
      "id": 3343277,
      "postDate": "2025-11-21T14:42:25.380Z",
      "content": "<p>“kaggle error” need to wait for 1h</p>",
      "rawMarkdown": "“kaggle error” need to wait for 1h"
    },
    {
      "id": 3343170,
      "postDate": "2025-11-21T13:13:57.733Z",
      "content": "<p>Same Error</p>",
      "rawMarkdown": "Same Error"
    }
  ],
  "comments": [
    {
      "id": 3393603,
      "author_name": "tingyi",
      "author_url": "",
      "post_date": "2026-01-19T11:45:54.033000",
      "content": "<p>I used the official evaluation code locally to assess the effectiveness of some post-processing methods, and the local results looked quite promising. However, after submitting to the Public Leaderboard, I initially received a \"Kaggle Error.\"</p>\n<p>About 30 minutes later, the error automatically disappeared, and a score was calculated. However, this score was at least 2-3% lower than my previous results (or lower than expected).</p>\n<p>I am not sure if the drop in score is related to this Kaggle Error, or if our methods simply failed to generalize. Regardless, the appearance of the Kaggle Error was quite strange.</p>\n<p>I was wondering if anyone else experienced the same situation with their scores?</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 3354510,
      "author_name": "TheOneTheOnly",
      "author_url": "",
      "post_date": "2025-11-30T10:37:49.110000",
      "content": "<p>so basically every time we submit it will take 9 hours to process then another 1 hour to resolve whatever that kaggle error is ? I have submitted 4 times and each time it took 10 hours to submit</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3354523,
          "author_name": "Satwik",
          "author_url": "",
          "post_date": "2025-11-30T10:44:22.383000",
          "content": "<p>Not sure why it takes that long for you. Most of my submissions take ~2 hours to run , and ~3 hours to score. </p>",
          "votes": 3,
          "replies": []
        }
      ]
    },
    {
      "id": 3351420,
      "author_name": "Jirka",
      "author_url": "",
      "post_date": "2025-11-28T11:58:06.983000",
      "content": "<p>I did face something similar at the beginning until I realised that annotation has three classes but prediction has to be only binary 1/0 and with the same volume dimension and data-type as uint8…\nThere is how I handle the third class for training and ensure correct format for submission: <a href=\"https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation\" target=\"_blank\">https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation</a></p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 3405505,
      "author_name": "Arpit1Bansal",
      "author_url": "",
      "post_date": "2026-02-13T08:41:52.227000",
      "content": "<p>I am facing Submission scoring error.\nwhere sometimes i just changed the model.\nOne time changing the model, doesn't caused error, but other time it happened.\nThis type of errors are too shit, i also added assert checks to see if some issue in internal runs, but the submission mask's dtype or values are what expected unit8:0,1 . throwed only submission scoring error.</p>\n<p>This is really annoying.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3402440,
      "author_name": "Diptyajit Das",
      "author_url": "",
      "post_date": "2026-02-06T04:30:57.270000",
      "content": "<p>Getting Kaggle Error in 12th hr from submission then on 13th hr getting Submission Scoring Error. Used the same predict function which worked before and also did validation with the output using competition metric in local. Is there any specific change that worked for you <a href=\"https://www.kaggle.com/p4rallax\" target=\"_blank\">@p4rallax</a> ?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3402567,
          "author_name": "Satwik",
          "author_url": "",
          "post_date": "2026-02-06T10:26:46.017000",
          "content": "<p>Nope , I made no changes, it was resolved on its own after a while.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3402569,
              "author_name": "",
              "author_url": "",
              "post_date": "2026-02-06T10:30:44.340000",
              "content": "",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3399323,
      "author_name": "Seeing Times",
      "author_url": "",
      "post_date": "2026-01-30T16:37:46.417000",
      "content": "<p>im facing the same issues</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3399301,
      "author_name": "Garage",
      "author_url": "",
      "post_date": "2026-01-30T15:58:31.223000",
      "content": "<p>Anyone getting imagecodecs error? We need to submit the notebook offline, but the package doesn't exists in Kaggle runtimes. So I tried to add it as a dataset and add to my notebook but still errors and I've wasted my daily submissions to these bugs :(</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3399368,
          "author_name": "Muhammad Ibrahim",
          "author_url": "",
          "post_date": "2026-01-30T18:28:21.120000",
          "content": "<p>On top of the notebook editor, you'll see Add-ons. click on it and click on Install Dependencies. Then add this to packages: pip install imagecodecs, and click save. It will install without turning the internet on.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3391079,
      "author_name": "MohanaRC",
      "author_url": "",
      "post_date": "2026-01-14T11:17:41.317000",
      "content": "<p>I'm encountering kaggle error on a repeated basis on submission. The process takes around 4+ hours and I end up with a kaggle error. Is anyone still facing issues with errors on submission?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3391090,
          "author_name": "Satwik",
          "author_url": "",
          "post_date": "2026-01-14T11:35:46.303000",
          "content": "<p>We had Kaggle Error issue too , but it resolved itself eventually. If it doesn't for you, you will probably have to debug your notebook and check for any exceptions</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3391124,
              "author_name": "MohanaRC",
              "author_url": "",
              "post_date": "2026-01-14T12:46:20.333000",
              "content": "<p>Okay so one of the submissions worked out somehow. Very confusing! </p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3386467,
      "author_name": "Kh0a",
      "author_url": "",
      "post_date": "2026-01-05T10:26:49.797000",
      "content": "<p>This also happened to me; it appeared as \"Kaggle error\" then \"Submission error.\" Have you found the solution yet?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3386521,
          "author_name": "TheOneTheOnly",
          "author_url": "",
          "post_date": "2026-01-05T12:54:40.827000",
          "content": "<p>Just reload a few time and your score will appear</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 3402428,
          "author_name": "",
          "author_url": "",
          "post_date": "2026-02-06T04:01:59.997000",
          "content": "",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3364597,
      "author_name": "Manas Choudhary",
      "author_url": "",
      "post_date": "2025-12-06T15:22:39.143000",
      "content": "<p>Why so many kaggle errors <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> ? Is there's something on the participant's end which is making these kaggle errors common , or on kaggle's side.\nThe problem with kaggle error is that you get an error and you don't even know which direction to proceed to.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3364674,
          "author_name": "Manas Choudhary",
          "author_url": "",
          "post_date": "2025-12-06T16:11:19.787000",
          "content": "<p>My submission showed kaggle error, and now suddenly it showed submission complete.</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3365010,
              "author_name": "Jirka",
              "author_url": "",
              "post_date": "2025-12-06T21:24:24.460000",
              "content": "<p>Happened to me also, just re-submit helped… </p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3343862,
      "author_name": "Tom",
      "author_url": "",
      "post_date": "2025-11-22T05:24:35.023000",
      "content": "<p>tag <a href=\"https://www.kaggle.com/giorgioangelotti\" target=\"_blank\">@giorgioangelotti</a>  <a href=\"https://www.kaggle.com/sohier\" target=\"_blank\">@sohier</a> for help</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3343481,
      "author_name": "Arunodhayan",
      "author_url": "",
      "post_date": "2025-11-21T17:29:46.870000",
      "content": "<p>same here </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3343277,
      "author_name": "Boredom",
      "author_url": "",
      "post_date": "2025-11-21T14:42:25.380000",
      "content": "<p>“kaggle error” need to wait for 1h</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3343170,
      "author_name": "clwclw",
      "author_url": "",
      "post_date": "2025-11-21T13:13:57.733000",
      "content": "<p>Same Error</p>",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3393603": "I used the official evaluation code locally to assess the effectiveness of some post-processing methods, and the local results looked quite promising. However, after submitting to the Public Leaderboard, I initially received a \"Kaggle Error.\"\n\nAbout 30 minutes later, the error automatically disappeared, and a score was calculated. However, this score was at least 2-3% lower than my previous results (or lower than expected).\n\nI am not sure if the drop in score is related to this Kaggle Error, or if our methods simply failed to generalize. Regardless, the appearance of the Kaggle Error was quite strange.\n\n I was wondering if anyone else experienced the same situation with their scores?",
    "3343108": "Hi , we made 3 submissions today and all have failed, two with Submission Scoring Error, and one of them had Kaggle Error. We used the exact same notebook that worked before, with just different models.\n\nIs anyone else facing similar issues?",
    "3354510": "so basically every time we submit it will take 9 hours to process then another 1 hour to resolve whatever that kaggle error is ? I have submitted 4 times and each time it took 10 hours to submit",
    "3351420": "I did face something similar at the beginning until I realised that annotation has three classes but prediction has to be only binary 1/0 and with the same volume dimension and data-type as uint8...\nThere is how I handle the third class for training and ensure correct format for submission: https://www.kaggle.com/code/jirkaborovec/surface-train-inference-slice-2d-segmentation",
    "3405505": "I am facing Submission scoring error.\nwhere sometimes i just changed the model.\nOne time changing the model, doesn't caused error, but other time it happened.\nThis type of errors are too shit, i also added assert checks to see if some issue in internal runs, but the submission mask's dtype or values are what expected unit8:0,1 . throwed only submission scoring error.\n\nThis is really annoying.",
    "3402440": "Getting Kaggle Error in 12th hr from submission then on 13th hr getting Submission Scoring Error. Used the same predict function which worked before and also did validation with the output using competition metric in local. Is there any specific change that worked for you @p4rallax ?",
    "3399323": "im facing the same issues",
    "3399301": "Anyone getting imagecodecs error? We need to submit the notebook offline, but the package doesn't exists in Kaggle runtimes. So I tried to add it as a dataset and add to my notebook but still errors and I've wasted my daily submissions to these bugs :(",
    "3391079": "I'm encountering kaggle error on a repeated basis on submission. The process takes around 4+ hours and I end up with a kaggle error. Is anyone still facing issues with errors on submission?",
    "3386467": "This also happened to me; it appeared as \"Kaggle error\" then \"Submission error.\" Have you found the solution yet?",
    "3364597": "Why so many kaggle errors @sohier ? Is there's something on the participant's end which is making these kaggle errors common , or on kaggle's side.\nThe problem with kaggle error is that you get an error and you don't even know which direction to proceed to.",
    "3343862": "tag @giorgioangelotti  @sohier for help",
    "3343481": "same here ",
    "3343277": "“kaggle error” need to wait for 1h",
    "3343170": "Same Error"
  }
}