{
  "id": 400797,
  "title": "[solved] How do I identify Cause of Submission Scoring Error?",
  "url": "/competitions/tlvmc-parkinsons-freezing-gait-prediction/discussion/400797",
  "author_name": "",
  "post_date": "2023-04-10T09:21:55.113242600Z",
  "votes": 2,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Edit: fixed the table<br>\nI have looked at the notebook logs after running but they don't appear to include information about what caused the error that I can use for debugging. This is an example of a run of my current initial program on the test data.</p>\n<table>\n<thead>\n<tr>\n<th>Line No.</th>\n<th>Id</th>\n<th>StartHesitation</th>\n<th>Turn</th>\n<th>Walking</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>0</td>\n<td>02ab235146_0</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>1</td>\n<td>02ab235146_1</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>2</td>\n<td>02ab235146_2</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>3</td>\n<td>02ab235146_3</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>4</td>\n<td>02ab235146_4</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>…     …     …     …     …</td>\n<td></td>\n<td></td>\n<td></td>\n<td></td>\n</tr>\n<tr>\n<td>7150</td>\n<td>02ab235146_7150</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.301283</td>\n</tr>\n<tr>\n<td>7151</td>\n<td>02ab235146_7151</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.296252</td>\n</tr>\n<tr>\n<td>7152</td>\n<td>02ab235146_7152</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.304617</td>\n</tr>\n<tr>\n<td>7153</td>\n<td>02ab235146_7153</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.311128</td>\n</tr>\n<tr>\n<td>7154</td>\n<td>02ab235146_7154</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.306049</td>\n</tr>\n</tbody>\n</table>",
  "messages": [
    {
      "id": "2216696",
      "postDate": "04/10/2023 09:21:55",
      "content": "<p>Edit: fixed the table<br>\nI have looked at the notebook logs after running but they don't appear to include information about what caused the error that I can use for debugging. This is an example of a run of my current initial program on the test data.</p>\n<table>\n<thead>\n<tr>\n<th>Line No.</th>\n<th>Id</th>\n<th>StartHesitation</th>\n<th>Turn</th>\n<th>Walking</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>0</td>\n<td>02ab235146_0</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>1</td>\n<td>02ab235146_1</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>2</td>\n<td>02ab235146_2</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>3</td>\n<td>02ab235146_3</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>4</td>\n<td>02ab235146_4</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.000000</td>\n</tr>\n<tr>\n<td>…     …     …     …     …</td>\n<td></td>\n<td></td>\n<td></td>\n<td></td>\n</tr>\n<tr>\n<td>7150</td>\n<td>02ab235146_7150</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.301283</td>\n</tr>\n<tr>\n<td>7151</td>\n<td>02ab235146_7151</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.296252</td>\n</tr>\n<tr>\n<td>7152</td>\n<td>02ab235146_7152</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.304617</td>\n</tr>\n<tr>\n<td>7153</td>\n<td>02ab235146_7153</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.311128</td>\n</tr>\n<tr>\n<td>7154</td>\n<td>02ab235146_7154</td>\n<td>0.0</td>\n<td>0.0</td>\n<td>0.306049</td>\n</tr>\n</tbody>\n</table>",
      "rawMarkdown": "Edit: fixed the table\nI have looked at the notebook logs after running but they don't appear to include information about what caused the error that I can use for debugging. This is an example of a run of my current initial program on the test data.\n\nLine No.| Id|StartHesitation|Turn|Walking|\n|---|---|---|---|\n0|02ab235146_0 |0.0|0.0|0.000000\n1|02ab235146_1 |0.0 |0.0|0.000000\n2|02ab235146_2|0.0|0.0|0.000000\n3|02ab235146_3|0.0|0.0|0.000000\n4|02ab235146_4|0.0|0.0|0.000000\n... \t... \t... \t... \t...\n7150|02ab235146_7150|0.0|0.0|0.301283\n7151|02ab235146_7151|0.0|0.0|0.296252\n7152|02ab235146_7152|0.0|0.0|0.304617\n7153|02ab235146_7153|0.0|0.0|0.311128\n7154|02ab235146_7154|0.0|0.0|0.306049",
      "votes": null
    },
    {
      "id": "2216974",
      "postDate": "04/10/2023 13:52:40",
      "content": "<p>If this if the format of your submission file, then one column is missing. We have to predict three targets. It is not clear if this is a header misplacement issue, but is the actual ID located in the 'StartHesitation' column?</p>",
      "rawMarkdown": "If this if the format of your submission file, then one column is missing. We have to predict three targets. It is not clear if this is a header misplacement issue, but is the actual ID located in the 'StartHesitation' column?",
      "votes": null
    },
    {
      "id": "2217218",
      "postDate": "04/10/2023 17:33:51",
      "content": "<p>Yes sorry, here is a screenshot with the values. I did realize I had been using my code for only a sampling of the test data, but fixed that and am still receiving the same issue </p>",
      "rawMarkdown": "Yes sorry, here is a screenshot with the values. I did realize I had been using my code for only a sampling of the test data, but fixed that and am still receiving the same issue",
      "votes": null
    },
    {
      "id": "2217222",
      "postDate": "04/10/2023 17:34:39",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1114736%2F75f81acdf5c877d0ebf0f0b10316d4bb%2FScreenshot%202023-04-10%20133418.png?generation=1681148076127114&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1114736%2F75f81acdf5c877d0ebf0f0b10316d4bb%2FScreenshot%202023-04-10%20133418.png?generation=1681148076127114&alt=media)",
      "votes": null
    },
    {
      "id": "2217487",
      "postDate": "04/11/2023 00:14:13",
      "content": "<p>Hey Renee, there are ~4,600 rows in the visible tDCS test data and ~282,000 in the defog set, so the number of rows jumps out at me as a possible issue -- there should be a 02ab235146 and 003f117e14 file as well, so I'd expect to see both of those file names in the id column if you are sharing the head and tail.</p>\n<p>You might consider trying a tail() and head() command on the sample submission file included in the competition data set to see if it matches your file.   </p>",
      "rawMarkdown": "Hey Renee, there are ~4,600 rows in the visible tDCS test data and ~282,000 in the defog set, so the number of rows jumps out at me as a possible issue -- there should be a 02ab235146 and 003f117e14 file as well, so I'd expect to see both of those file names in the id column if you are sharing the head and tail.\n\nYou might consider trying a tail() and head() command on the sample submission file included in the competition data set to see if it matches your file.",
      "votes": null
    },
    {
      "id": "2217621",
      "postDate": "04/11/2023 04:03:38",
      "content": "<p>Yes, I had noticed this issue and corrected it (I forgot to remove my sampling from earlier tests so a smaller number of points was being used) and unfortunately I am still getting the error after correcting it.</p>",
      "rawMarkdown": "Yes, I had noticed this issue and corrected it (I forgot to remove my sampling from earlier tests so a smaller number of points was being used) and unfortunately I am still getting the error after correcting it.",
      "votes": null
    },
    {
      "id": "2218410",
      "postDate": "04/11/2023 16:19:33",
      "content": "<p>Hmm, i'm not sure if it matters or not but the sample submission file has the TDCS file (003f117e14) first then the defog data.  I downloaded my submission file and (in mac terminal) ran: <br>\n<code>head -4685 submission.csv | tail -12</code> in order to see if the format matched the sample.</p>\n<p>For example:</p>\n<table>\n<thead>\n<tr>\n<th>id</th>\n<th>StartHesitation</th>\n<th>Turn</th>\n<th>Walking</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>003f117e14_4672</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4673</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4674</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4675</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4676</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4677</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4678</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4679</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4680</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4681</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>02ab235146_0</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>02ab235146_1</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n</tbody>\n</table>",
      "rawMarkdown": "Hmm, i'm not sure if it matters or not but the sample submission file has the TDCS file (003f117e14) first then the defog data.  I downloaded my submission file and (in mac terminal) ran: \n```head -4685 submission.csv | tail -12``` in order to see if the format matched the sample.\n\nFor example:\n| id | StartHesitation | Turn | Walking|\n| --- | --- | --- | --- |\n003f117e14_4672|0|0|0\n003f117e14_4673|0|0|0\n003f117e14_4674|0|0|0\n003f117e14_4675|0|0|0\n003f117e14_4676|0|0|0\n003f117e14_4677|0|0|0\n003f117e14_4678|0|0|0\n003f117e14_4679|0|0|0\n003f117e14_4680|0|0|0\n003f117e14_4681|0|0|0\n02ab235146_0|0|0|0\n02ab235146_1|0|0|0",
      "votes": null
    },
    {
      "id": "2218685",
      "postDate": "04/11/2023 23:21:19",
      "content": "<p>Upon comparing my output and the sample submission file, I have realized that mine is one line shorter. I will follow this lead and see if it helps me find the problem. Thank you!</p>",
      "rawMarkdown": "Upon comparing my output and the sample submission file, I have realized that mine is one line shorter. I will follow this lead and see if it helps me find the problem. Thank you!",
      "votes": null
    },
    {
      "id": "2219482",
      "postDate": "04/12/2023 15:48:53",
      "content": "<p>The number of lines was the issue. Thanks for your help!</p>",
      "rawMarkdown": "The number of lines was the issue. Thanks for your help!",
      "votes": null
    },
    {
      "id": "2226573",
      "postDate": "04/19/2023 03:39:42",
      "content": "<p>did you resolve the submission scoring error issue?</p>",
      "rawMarkdown": "did you resolve the submission scoring error issue?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2216974,
      "author_name": "jdeneva",
      "author_url": "",
      "post_date": "04/10/2023 13:52:40",
      "content": "<p>If this if the format of your submission file, then one column is missing. We have to predict three targets. It is not clear if this is a header misplacement issue, but is the actual ID located in the 'StartHesitation' column?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2217218,
          "author_name": "reneeschmidt",
          "author_url": "",
          "post_date": "04/10/2023 17:33:51",
          "content": "<p>Yes sorry, here is a screenshot with the values. I did realize I had been using my code for only a sampling of the test data, but fixed that and am still receiving the same issue </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 2217222,
          "author_name": "reneeschmidt",
          "author_url": "",
          "post_date": "04/10/2023 17:34:39",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1114736%2F75f81acdf5c877d0ebf0f0b10316d4bb%2FScreenshot%202023-04-10%20133418.png?generation=1681148076127114&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": [
            {
              "id": 2226573,
              "author_name": "backpack30",
              "author_url": "",
              "post_date": "04/19/2023 03:39:42",
              "content": "<p>did you resolve the submission scoring error issue?</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 2217487,
      "author_name": "austinhinkel",
      "author_url": "",
      "post_date": "04/11/2023 00:14:13",
      "content": "<p>Hey Renee, there are ~4,600 rows in the visible tDCS test data and ~282,000 in the defog set, so the number of rows jumps out at me as a possible issue -- there should be a 02ab235146 and 003f117e14 file as well, so I'd expect to see both of those file names in the id column if you are sharing the head and tail.</p>\n<p>You might consider trying a tail() and head() command on the sample submission file included in the competition data set to see if it matches your file.   </p>",
      "votes": null,
      "replies": [
        {
          "id": 2217621,
          "author_name": "reneeschmidt",
          "author_url": "",
          "post_date": "04/11/2023 04:03:38",
          "content": "<p>Yes, I had noticed this issue and corrected it (I forgot to remove my sampling from earlier tests so a smaller number of points was being used) and unfortunately I am still getting the error after correcting it.</p>",
          "votes": null,
          "replies": [
            {
              "id": 2218410,
              "author_name": "austinhinkel",
              "author_url": "",
              "post_date": "04/11/2023 16:19:33",
              "content": "<p>Hmm, i'm not sure if it matters or not but the sample submission file has the TDCS file (003f117e14) first then the defog data.  I downloaded my submission file and (in mac terminal) ran: <br>\n<code>head -4685 submission.csv | tail -12</code> in order to see if the format matched the sample.</p>\n<p>For example:</p>\n<table>\n<thead>\n<tr>\n<th>id</th>\n<th>StartHesitation</th>\n<th>Turn</th>\n<th>Walking</th>\n</tr>\n</thead>\n<tbody>\n<tr>\n<td>003f117e14_4672</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4673</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4674</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4675</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4676</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4677</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4678</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4679</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4680</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>003f117e14_4681</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>02ab235146_0</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n<tr>\n<td>02ab235146_1</td>\n<td>0</td>\n<td>0</td>\n<td>0</td>\n</tr>\n</tbody>\n</table>",
              "votes": null,
              "replies": [
                {
                  "id": 2218685,
                  "author_name": "reneeschmidt",
                  "author_url": "",
                  "post_date": "04/11/2023 23:21:19",
                  "content": "<p>Upon comparing my output and the sample submission file, I have realized that mine is one line shorter. I will follow this lead and see if it helps me find the problem. Thank you!</p>",
                  "votes": null,
                  "replies": []
                },
                {
                  "id": 2219482,
                  "author_name": "reneeschmidt",
                  "author_url": "",
                  "post_date": "04/12/2023 15:48:53",
                  "content": "<p>The number of lines was the issue. Thanks for your help!</p>",
                  "votes": null,
                  "replies": []
                }
              ]
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2216696": "Edit: fixed the table\nI have looked at the notebook logs after running but they don't appear to include information about what caused the error that I can use for debugging. This is an example of a run of my current initial program on the test data.\n\nLine No.| Id|StartHesitation|Turn|Walking|\n|---|---|---|---|\n0|02ab235146_0 |0.0|0.0|0.000000\n1|02ab235146_1 |0.0 |0.0|0.000000\n2|02ab235146_2|0.0|0.0|0.000000\n3|02ab235146_3|0.0|0.0|0.000000\n4|02ab235146_4|0.0|0.0|0.000000\n... \t... \t... \t... \t...\n7150|02ab235146_7150|0.0|0.0|0.301283\n7151|02ab235146_7151|0.0|0.0|0.296252\n7152|02ab235146_7152|0.0|0.0|0.304617\n7153|02ab235146_7153|0.0|0.0|0.311128\n7154|02ab235146_7154|0.0|0.0|0.306049",
    "2216974": "If this if the format of your submission file, then one column is missing. We have to predict three targets. It is not clear if this is a header misplacement issue, but is the actual ID located in the 'StartHesitation' column?",
    "2217218": "Yes sorry, here is a screenshot with the values. I did realize I had been using my code for only a sampling of the test data, but fixed that and am still receiving the same issue",
    "2217222": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F1114736%2F75f81acdf5c877d0ebf0f0b10316d4bb%2FScreenshot%202023-04-10%20133418.png?generation=1681148076127114&alt=media)",
    "2217487": "Hey Renee, there are ~4,600 rows in the visible tDCS test data and ~282,000 in the defog set, so the number of rows jumps out at me as a possible issue -- there should be a 02ab235146 and 003f117e14 file as well, so I'd expect to see both of those file names in the id column if you are sharing the head and tail.\n\nYou might consider trying a tail() and head() command on the sample submission file included in the competition data set to see if it matches your file.",
    "2217621": "Yes, I had noticed this issue and corrected it (I forgot to remove my sampling from earlier tests so a smaller number of points was being used) and unfortunately I am still getting the error after correcting it.",
    "2218410": "Hmm, i'm not sure if it matters or not but the sample submission file has the TDCS file (003f117e14) first then the defog data.  I downloaded my submission file and (in mac terminal) ran: \n```head -4685 submission.csv | tail -12``` in order to see if the format matched the sample.\n\nFor example:\n| id | StartHesitation | Turn | Walking|\n| --- | --- | --- | --- |\n003f117e14_4672|0|0|0\n003f117e14_4673|0|0|0\n003f117e14_4674|0|0|0\n003f117e14_4675|0|0|0\n003f117e14_4676|0|0|0\n003f117e14_4677|0|0|0\n003f117e14_4678|0|0|0\n003f117e14_4679|0|0|0\n003f117e14_4680|0|0|0\n003f117e14_4681|0|0|0\n02ab235146_0|0|0|0\n02ab235146_1|0|0|0",
    "2218685": "Upon comparing my output and the sample submission file, I have realized that mine is one line shorter. I will follow this lead and see if it helps me find the problem. Thank you!",
    "2219482": "The number of lines was the issue. Thanks for your help!",
    "2226573": "did you resolve the submission scoring error issue?"
  },
  "source": "meta"
}