{
  "id": 185340,
  "title": "Hidden data set - Notebook Threw Exception",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/185340",
  "author_name": "Alexandre Blanchet",
  "post_date": "2020-09-20T13:41:56.832000",
  "votes": 0,
  "comment_count": 7,
  "views": 0,
  "content": "<p>Hi all,</p>\n<p>Do you know if there is a way to get some log when doing a submission? I keep getting Notebook Threw Exception  but dont know where is the bug.<br>\nThanks a lot, <br>\nAlex</p>",
  "messages": [
    {
      "id": 1019519,
      "postDate": "2020-09-20T13:56:10.073Z",
      "content": "<p><a href=\"https://www.kaggle.com/haha89\" target=\"_blank\">@haha89</a> Hey Alex! <br>\nDid you check your kernel after pushing all the latest updates? can you see any exceptions there? if not please make sure you have saved the results as specified in the competition instructions. <br>\nhope it is of help for you,<br>\nThomas. </p>",
      "rawMarkdown": "@haha89 Hey Alex! \nDid you check your kernel after pushing all the latest updates? can you see any exceptions there? if not please make sure you have saved the results as specified in the competition instructions. \nhope it is of help for you,\nThomas. ",
      "votes": 1,
      "replies": [
        {
          "id": 1019557,
          "postDate": "2020-09-20T14:15:44.627Z",
          "content": "<p>HI Thomas, thanks for your time. I was able to successfully submit once, when removing all the CT scans processing. So I believe the bug happens during the scan preprocessing on the hidden test set. However it works on the train set. <br>\nSo i would love to know which line of code throws the exception, and the log would be useful…</p>",
          "rawMarkdown": "HI Thomas, thanks for your time. I was able to successfully submit once, when removing all the CT scans processing. So I believe the bug happens during the scan preprocessing on the hidden test set. However it works on the train set. \nSo i would love to know which line of code throws the exception, and the log would be useful...",
          "replies": [
            {
              "id": 1019646,
              "postDate": "2020-09-20T15:04:40.987Z",
              "content": "<p>Typical issues:<br>\nPrivate test set is larger than sample test set. Are you running out of memory? time?<br>\nDataFrame appends, image arrays can use lots of memory.<br>\nPublic test set duplicates train set images. Make sure you don't assume anything about the real test set names.<br>\nDoes your (hidden) submission file have all the rows. Good practice is to read in the hidden sample_submission and replace rows with your guesses. Guarantees all rows are present.</p>",
              "rawMarkdown": "Typical issues:\nPrivate test set is larger than sample test set. Are you running out of memory? time?\nDataFrame appends, image arrays can use lots of memory.\nPublic test set duplicates train set images. Make sure you don't assume anything about the real test set names.\nDoes your (hidden) submission file have all the rows. Good practice is to read in the hidden sample_submission and replace rows with your guesses. Guarantees all rows are present.",
              "votes": 1
            },
            {
              "id": 1020942,
              "postDate": "2020-09-21T14:24:38.890Z",
              "content": "<p>So for instance, submitting directly the sample_submission file should give me a score ?</p>",
              "rawMarkdown": "So for instance, submitting directly the sample_submission file should give me a score ?"
            },
            {
              "id": 1021024,
              "postDate": "2020-09-21T15:10:27.503Z",
              "content": "<p>Yes. Many of the \"popular\" results on the leaderboard are simply a sample_submission file with a default label value. Note that in a committed notebook, you must use the hidden sample_submission.csv file. You cannot use the downloadable public sample_submission.csv file.</p>\n<p>-Rich</p>",
              "rawMarkdown": "Yes. Many of the \"popular\" results on the leaderboard are simply a sample_submission file with a default label value. Note that in a committed notebook, you must use the hidden sample_submission.csv file. You cannot use the downloadable public sample_submission.csv file.\n\n-Rich",
              "votes": 1
            },
            {
              "id": 1021141,
              "postDate": "2020-09-21T16:47:58.943Z",
              "content": "<p>Thank you Richard for your help !</p>",
              "rawMarkdown": "Thank you Richard for your help !"
            }
          ]
        },
        {
          "id": 1019603,
          "postDate": "2020-09-20T14:33:06.013Z",
          "rawMarkdown": "",
          "isDeleted": true
        }
      ]
    },
    {
      "id": 1019502,
      "postDate": "2020-09-20T13:41:56.833Z",
      "content": "<p>Hi all,</p>\n<p>Do you know if there is a way to get some log when doing a submission? I keep getting Notebook Threw Exception  but dont know where is the bug.<br>\nThanks a lot, <br>\nAlex</p>",
      "rawMarkdown": "Hi all,\n\nDo you know if there is a way to get some log when doing a submission? I keep getting Notebook Threw Exception  but dont know where is the bug.\nThanks a lot, \nAlex"
    }
  ],
  "comments": [
    {
      "id": 1019519,
      "author_name": "Thomas Konstantin",
      "author_url": "",
      "post_date": "2020-09-20T13:56:10.073000",
      "content": "<p><a href=\"https://www.kaggle.com/haha89\" target=\"_blank\">@haha89</a> Hey Alex! <br>\nDid you check your kernel after pushing all the latest updates? can you see any exceptions there? if not please make sure you have saved the results as specified in the competition instructions. <br>\nhope it is of help for you,<br>\nThomas. </p>",
      "votes": 1,
      "replies": [
        {
          "id": 1019557,
          "author_name": "Alexandre Blanchet",
          "author_url": "",
          "post_date": "2020-09-20T14:15:44.627000",
          "content": "<p>HI Thomas, thanks for your time. I was able to successfully submit once, when removing all the CT scans processing. So I believe the bug happens during the scan preprocessing on the hidden test set. However it works on the train set. <br>\nSo i would love to know which line of code throws the exception, and the log would be useful…</p>",
          "votes": 0,
          "replies": [
            {
              "id": 1019646,
              "author_name": "quadcore/Richard Epstein",
              "author_url": "",
              "post_date": "2020-09-20T15:04:40.987000",
              "content": "<p>Typical issues:<br>\nPrivate test set is larger than sample test set. Are you running out of memory? time?<br>\nDataFrame appends, image arrays can use lots of memory.<br>\nPublic test set duplicates train set images. Make sure you don't assume anything about the real test set names.<br>\nDoes your (hidden) submission file have all the rows. Good practice is to read in the hidden sample_submission and replace rows with your guesses. Guarantees all rows are present.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 1020942,
              "author_name": "Alexandre Blanchet",
              "author_url": "",
              "post_date": "2020-09-21T14:24:38.890000",
              "content": "<p>So for instance, submitting directly the sample_submission file should give me a score ?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 1021024,
              "author_name": "quadcore/Richard Epstein",
              "author_url": "",
              "post_date": "2020-09-21T15:10:27.503000",
              "content": "<p>Yes. Many of the \"popular\" results on the leaderboard are simply a sample_submission file with a default label value. Note that in a committed notebook, you must use the hidden sample_submission.csv file. You cannot use the downloadable public sample_submission.csv file.</p>\n<p>-Rich</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 1021141,
              "author_name": "Alexandre Blanchet",
              "author_url": "",
              "post_date": "2020-09-21T16:47:58.943000",
              "content": "<p>Thank you Richard for your help !</p>",
              "votes": 0,
              "replies": []
            }
          ]
        },
        {
          "id": 1019603,
          "author_name": "",
          "author_url": "",
          "post_date": "2020-09-20T14:33:06.013000",
          "content": "",
          "votes": 0,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1019519": "@haha89 Hey Alex! \nDid you check your kernel after pushing all the latest updates? can you see any exceptions there? if not please make sure you have saved the results as specified in the competition instructions. \nhope it is of help for you,\nThomas. ",
    "1019502": "Hi all,\n\nDo you know if there is a way to get some log when doing a submission? I keep getting Notebook Threw Exception  but dont know where is the bug.\nThanks a lot, \nAlex"
  }
}