{
  "id": 396825,
  "title": "When you see \"Submission Scoring Error\"...",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/396825",
  "author_name": "",
  "post_date": "2023-03-23T02:32:49.738500600Z",
  "votes": 6,
  "comment_count": 4,
  "views": 0,
  "content": "<p><a href=\"https://www.kaggle.com/tomokikmogura/psp-always-incrrect\" target=\"_blank\">This notebook</a> intentionally raise <code>AssertionError</code> at submission time. When I submitted this, the error message on Submissions tab was \"Submission Scoring Error\", not  \"Notebook Threw Exception\" which I expected. I guess that this notebook made \"submission.csv\" at first <code>iter_test</code> loop and raised <code>AssertionError</code> at second loop as I expected, and in such a case <strong>the kaggle environment tried to evaluate \"submission.csv\" even if unhandled error was raised</strong> then resulting in a \"Submission Scoring Error\" because there are only 1-batch prediction in \"submission.csv\".</p>\n<p>Actually I expected \"Notebook Threw Exception\" is shown in such a case. Below is error description in <a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">Code Competitions - Errors &amp; Debugging Tips</a>.</p>\n<blockquote>\n  <p><strong>Notebook Threw Exception</strong>: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset.</p>\n  <p><strong>Submission Scoring Error</strong>: Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.</p>\n</blockquote>\n<p>If you are fighting with \"Submission Scoring Error\" but cannot find where to fix, consider probability that your error occured <strong>after</strong> 1st <code>iter_test</code> loop successfully completed.</p>",
  "messages": [
    {
      "id": "2192967",
      "postDate": "03/23/2023 02:32:49",
      "content": "<p><a href=\"https://www.kaggle.com/tomokikmogura/psp-always-incrrect\" target=\"_blank\">This notebook</a> intentionally raise <code>AssertionError</code> at submission time. When I submitted this, the error message on Submissions tab was \"Submission Scoring Error\", not  \"Notebook Threw Exception\" which I expected. I guess that this notebook made \"submission.csv\" at first <code>iter_test</code> loop and raised <code>AssertionError</code> at second loop as I expected, and in such a case <strong>the kaggle environment tried to evaluate \"submission.csv\" even if unhandled error was raised</strong> then resulting in a \"Submission Scoring Error\" because there are only 1-batch prediction in \"submission.csv\".</p>\n<p>Actually I expected \"Notebook Threw Exception\" is shown in such a case. Below is error description in <a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">Code Competitions - Errors &amp; Debugging Tips</a>.</p>\n<blockquote>\n  <p><strong>Notebook Threw Exception</strong>: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset.</p>\n  <p><strong>Submission Scoring Error</strong>: Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.</p>\n</blockquote>\n<p>If you are fighting with \"Submission Scoring Error\" but cannot find where to fix, consider probability that your error occured <strong>after</strong> 1st <code>iter_test</code> loop successfully completed.</p>",
      "rawMarkdown": "[This notebook](https://www.kaggle.com/tomokikmogura/psp-always-incrrect) intentionally raise `AssertionError` at submission time. When I submitted this, the error message on Submissions tab was \"Submission Scoring Error\", not  \"Notebook Threw Exception\" which I expected. I guess that this notebook made \"submission.csv\" at first `iter_test` loop and raised `AssertionError` at second loop as I expected, and in such a case **the kaggle environment tried to evaluate \"submission.csv\" even if unhandled error was raised** then resulting in a \"Submission Scoring Error\" because there are only 1-batch prediction in \"submission.csv\".\n\nActually I expected \"Notebook Threw Exception\" is shown in such a case. Below is error description in [Code Competitions - Errors & Debugging Tips](https://www.kaggle.com/code-competition-debugging).\n\n> **Notebook Threw Exception**: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset.\n\n> **Submission Scoring Error**: Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.\n\nIf you are fighting with \"Submission Scoring Error\" but cannot find where to fix, consider probability that your error occured **after** 1st `iter_test` loop successfully completed.",
      "votes": null
    },
    {
      "id": "2250724",
      "postDate": "05/08/2023 18:19:17",
      "content": "<p>i am in the same exact situation, but don't know how to solve it …  could you tell what have you done in your case plz ?</p>",
      "rawMarkdown": "i am in the same exact situation, but don't know how to solve it ...  could you tell what have you done in your case plz ?",
      "votes": null
    },
    {
      "id": "2271628",
      "postDate": "05/24/2023 04:22:09",
      "content": "<p>Did you solved the problem?</p>",
      "rawMarkdown": "Did you solved the problem?",
      "votes": null
    },
    {
      "id": "2284404",
      "postDate": "06/02/2023 02:22:58",
      "content": "<p>I am on the same train. Really frustrated for being my first experience. Any insights?</p>",
      "rawMarkdown": "I am on the same train. Really frustrated for being my first experience. Any insights?",
      "votes": null
    },
    {
      "id": "2312558",
      "postDate": "06/22/2023 02:33:06",
      "content": "<p>Have you solved the issue ? I am battling with the exact same issue right now …</p>",
      "rawMarkdown": "Have you solved the issue ? I am battling with the exact same issue right now ...",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2250724,
      "author_name": "wouldyoujustfocus",
      "author_url": "",
      "post_date": "05/08/2023 18:19:17",
      "content": "<p>i am in the same exact situation, but don't know how to solve it …  could you tell what have you done in your case plz ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2271628,
          "author_name": "navinkumarmnk",
          "author_url": "",
          "post_date": "05/24/2023 04:22:09",
          "content": "<p>Did you solved the problem?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2284404,
      "author_name": "juancarloshidalgo",
      "author_url": "",
      "post_date": "06/02/2023 02:22:58",
      "content": "<p>I am on the same train. Really frustrated for being my first experience. Any insights?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2312558,
      "author_name": "qurious",
      "author_url": "",
      "post_date": "06/22/2023 02:33:06",
      "content": "<p>Have you solved the issue ? I am battling with the exact same issue right now …</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2192967": "[This notebook](https://www.kaggle.com/tomokikmogura/psp-always-incrrect) intentionally raise `AssertionError` at submission time. When I submitted this, the error message on Submissions tab was \"Submission Scoring Error\", not  \"Notebook Threw Exception\" which I expected. I guess that this notebook made \"submission.csv\" at first `iter_test` loop and raised `AssertionError` at second loop as I expected, and in such a case **the kaggle environment tried to evaluate \"submission.csv\" even if unhandled error was raised** then resulting in a \"Submission Scoring Error\" because there are only 1-batch prediction in \"submission.csv\".\n\nActually I expected \"Notebook Threw Exception\" is shown in such a case. Below is error description in [Code Competitions - Errors & Debugging Tips](https://www.kaggle.com/code-competition-debugging).\n\n> **Notebook Threw Exception**: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset.\n\n> **Submission Scoring Error**: Your notebook generated a submission file with incorrect format. Some examples causing this are: wrong number of rows or columns, empty values, an incorrect data type for a value, or invalid submission values from what is expected.\n\nIf you are fighting with \"Submission Scoring Error\" but cannot find where to fix, consider probability that your error occured **after** 1st `iter_test` loop successfully completed.",
    "2250724": "i am in the same exact situation, but don't know how to solve it ...  could you tell what have you done in your case plz ?",
    "2271628": "Did you solved the problem?",
    "2284404": "I am on the same train. Really frustrated for being my first experience. Any insights?",
    "2312558": "Have you solved the issue ? I am battling with the exact same issue right now ..."
  },
  "source": "meta"
}