{
  "id": 182187,
  "title": "Code competition debugging and errors",
  "url": "/competitions/osic-pulmonary-fibrosis-progression/discussion/182187",
  "author_name": "",
  "post_date": "2020-09-11T15:38:10.666081100Z",
  "votes": 21,
  "comment_count": 12,
  "views": 0,
  "content": "<p>We just published a page to describe the classes of errors you might receive in code competitions, as well as a few tips to avoid/debug errors:</p>\n<p><a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">https://www.kaggle.com/code-competition-debugging</a></p>\n<p>Please take a look if you are currently stuck and feel free to share this if you see others who might benefit. Finally, a huge thanks to the folks that have been helping out fellow Kagglers with solving their errors!</p>",
  "messages": [
    {
      "id": "1006852",
      "postDate": "09/11/2020 15:38:10",
      "content": "<p>We just published a page to describe the classes of errors you might receive in code competitions, as well as a few tips to avoid/debug errors:</p>\n<p><a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">https://www.kaggle.com/code-competition-debugging</a></p>\n<p>Please take a look if you are currently stuck and feel free to share this if you see others who might benefit. Finally, a huge thanks to the folks that have been helping out fellow Kagglers with solving their errors!</p>",
      "rawMarkdown": "We just published a page to describe the classes of errors you might receive in code competitions, as well as a few tips to avoid/debug errors:\n\nhttps://www.kaggle.com/code-competition-debugging\n\nPlease take a look if you are currently stuck and feel free to share this if you see others who might benefit. Finally, a huge thanks to the folks that have been helping out fellow Kagglers with solving their errors!",
      "votes": null
    },
    {
      "id": "1010412",
      "postDate": "09/14/2020 18:09:38",
      "content": "<p>Scoring submission may have some error. It is almost 3 hours since I submit my output. It takes only 20 minutes to run my code. However it is taking  over 2hours and still scoring. Is it server issue? </p>",
      "rawMarkdown": "Scoring submission may have some error. It is almost 3 hours since I submit my output. It takes only 20 minutes to run my code. However it is taking  over 2hours and still scoring. Is it server issue?",
      "votes": null
    },
    {
      "id": "1010573",
      "postDate": "09/14/2020 22:06:53",
      "content": "<p>interactive notebook only has 5 patients in the test set. Submitted notebook has about 200 to review. So expect it to take about 40 times longer, depending on your model.</p>",
      "rawMarkdown": "interactive notebook only has 5 patients in the test set. Submitted notebook has about 200 to review. So expect it to take about 40 times longer, depending on your model.",
      "votes": null
    },
    {
      "id": "1019670",
      "postDate": "09/20/2020 15:30:06",
      "content": "<p>thanks <a href=\"https://www.kaggle.com/richardepstein\" target=\"_blank\">@richardepstein</a> , your comment helped me and now I have made my submission faster</p>",
      "rawMarkdown": "thanks @richardepstein , your comment helped me and now I have made my submission faster",
      "votes": null
    },
    {
      "id": "1020248",
      "postDate": "09/21/2020 03:57:10",
      "content": "<p>I read <a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">https://www.kaggle.com/code-competition-debugging</a> but there's still a point I'm not sure about:<br>\nWhen I do a \"Submit Predictions\", is my script run against the entire hidden test set (public and private), and the score on the public portion displayed on the leaderboard, or is it run only on the public portion, and then run on the private portion when the contest is finished? If the latter, then it would be possible for the script to succeed during the contest period but fail in final scoring because of running out of RAM or time, etc.</p>",
      "rawMarkdown": "I read https://www.kaggle.com/code-competition-debugging but there's still a point I'm not sure about:\nWhen I do a \"Submit Predictions\", is my script run against the entire hidden test set (public and private), and the score on the public portion displayed on the leaderboard, or is it run only on the public portion, and then run on the private portion when the contest is finished? If the latter, then it would be possible for the script to succeed during the contest period but fail in final scoring because of running out of RAM or time, etc.",
      "votes": null
    },
    {
      "id": "1021130",
      "postDate": "09/21/2020 16:38:34",
      "content": "<p><a href=\"https://www.kaggle.com/dslate\" target=\"_blank\">@dslate</a> Good question - When you \"Submit Predictions,\" your code is run synchronously against the entire public + hidden private test sets. Therefore, in this competition, a successful submission on the public leaderboard indicates it also succeeded on the private. So if your submission returns an error, then it could have been attributable to an error on the private side of the re-run.</p>",
      "rawMarkdown": "dslate Good question - When you \"Submit Predictions,\" your code is run synchronously against the entire public + hidden private test sets. Therefore, in this competition, a successful submission on the public leaderboard indicates it also succeeded on the private. So if your submission returns an error, then it could have been attributable to an error on the private side of the re-run.",
      "votes": null
    },
    {
      "id": "1021144",
      "postDate": "09/21/2020 16:52:14",
      "content": "<p><a href=\"https://www.kaggle.com/juliaelliott\" target=\"_blank\">@juliaelliott</a> Thanks, that makes sense.</p>",
      "rawMarkdown": "juliaelliott Thanks, that makes sense.",
      "votes": null
    },
    {
      "id": "1032348",
      "postDate": "09/30/2020 06:21:08",
      "content": "<p><a href=\"https://www.kaggle.com/juliaelliott\" target=\"_blank\">@juliaelliott</a>, would it be possible to provide some error log to help debugging ? </p>",
      "rawMarkdown": "juliaelliott, would it be possible to provide some error log to help debugging ?",
      "votes": null
    },
    {
      "id": "1033030",
      "postDate": "09/30/2020 15:53:48",
      "content": "<p><a href=\"https://www.kaggle.com/joejeo1\" target=\"_blank\">@joejeo1</a> No, unfortunately we cannot provide any more detail on the private runs. This is because doing so runs the risk of being used for error-probing.</p>",
      "rawMarkdown": "joejeo1 No, unfortunately we cannot provide any more detail on the private runs. This is because doing so runs the risk of being used for error-probing.",
      "votes": null
    },
    {
      "id": "1036136",
      "postDate": "10/03/2020 13:12:10",
      "content": "<p>How  to install a R package and be able to submit a code, without internet access?  We have to use only those packages already in Kaggle's?<br>\nThankyou!</p>",
      "rawMarkdown": "How  to install a R package and be able to submit a code, without internet access?  We have to use only those packages already in Kaggle's?\nThankyou!",
      "votes": null
    },
    {
      "id": "1036587",
      "postDate": "10/04/2020 02:43:01",
      "content": "<p>When rerunning the notebook for private dataset, is the kernel restarted? does the output folder get refreshed?</p>",
      "rawMarkdown": "When rerunning the notebook for private dataset, is the kernel restarted? does the output folder get refreshed?",
      "votes": null
    },
    {
      "id": "1037179",
      "postDate": "10/04/2020 16:54:58",
      "content": "<p>See this notebook by CoreyLevinson, it worked for me: <a href=\"https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/\" target=\"_blank\">https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/</a></p>",
      "rawMarkdown": "See this notebook by CoreyLevinson, it worked for me: https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/",
      "votes": null
    },
    {
      "id": "1055823",
      "postDate": "10/21/2020 06:22:04",
      "content": "<p>test comment</p>",
      "rawMarkdown": "test comment",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1010412,
      "author_name": "taikiishii",
      "author_url": "",
      "post_date": "09/14/2020 18:09:38",
      "content": "<p>Scoring submission may have some error. It is almost 3 hours since I submit my output. It takes only 20 minutes to run my code. However it is taking  over 2hours and still scoring. Is it server issue? </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1010573,
      "author_name": "richardepstein",
      "author_url": "",
      "post_date": "09/14/2020 22:06:53",
      "content": "<p>interactive notebook only has 5 patients in the test set. Submitted notebook has about 200 to review. So expect it to take about 40 times longer, depending on your model.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1019670,
      "author_name": "anuragtr",
      "author_url": "",
      "post_date": "09/20/2020 15:30:06",
      "content": "<p>thanks <a href=\"https://www.kaggle.com/richardepstein\" target=\"_blank\">@richardepstein</a> , your comment helped me and now I have made my submission faster</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1020248,
      "author_name": "dslate",
      "author_url": "",
      "post_date": "09/21/2020 03:57:10",
      "content": "<p>I read <a href=\"https://www.kaggle.com/code-competition-debugging\" target=\"_blank\">https://www.kaggle.com/code-competition-debugging</a> but there's still a point I'm not sure about:<br>\nWhen I do a \"Submit Predictions\", is my script run against the entire hidden test set (public and private), and the score on the public portion displayed on the leaderboard, or is it run only on the public portion, and then run on the private portion when the contest is finished? If the latter, then it would be possible for the script to succeed during the contest period but fail in final scoring because of running out of RAM or time, etc.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1021130,
          "author_name": "juliaelliott",
          "author_url": "",
          "post_date": "09/21/2020 16:38:34",
          "content": "<p><a href=\"https://www.kaggle.com/dslate\" target=\"_blank\">@dslate</a> Good question - When you \"Submit Predictions,\" your code is run synchronously against the entire public + hidden private test sets. Therefore, in this competition, a successful submission on the public leaderboard indicates it also succeeded on the private. So if your submission returns an error, then it could have been attributable to an error on the private side of the re-run.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1021144,
          "author_name": "dslate",
          "author_url": "",
          "post_date": "09/21/2020 16:52:14",
          "content": "<p><a href=\"https://www.kaggle.com/juliaelliott\" target=\"_blank\">@juliaelliott</a> Thanks, that makes sense.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1032348,
          "author_name": "joejeo1",
          "author_url": "",
          "post_date": "09/30/2020 06:21:08",
          "content": "<p><a href=\"https://www.kaggle.com/juliaelliott\" target=\"_blank\">@juliaelliott</a>, would it be possible to provide some error log to help debugging ? </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1033030,
          "author_name": "juliaelliott",
          "author_url": "",
          "post_date": "09/30/2020 15:53:48",
          "content": "<p><a href=\"https://www.kaggle.com/joejeo1\" target=\"_blank\">@joejeo1</a> No, unfortunately we cannot provide any more detail on the private runs. This is because doing so runs the risk of being used for error-probing.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1036136,
      "author_name": "rpsantosakaggle",
      "author_url": "",
      "post_date": "10/03/2020 13:12:10",
      "content": "<p>How  to install a R package and be able to submit a code, without internet access?  We have to use only those packages already in Kaggle's?<br>\nThankyou!</p>",
      "votes": null,
      "replies": [
        {
          "id": 1037179,
          "author_name": "dslate",
          "author_url": "",
          "post_date": "10/04/2020 16:54:58",
          "content": "<p>See this notebook by CoreyLevinson, it worked for me: <a href=\"https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/\" target=\"_blank\">https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/</a></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1036587,
      "author_name": "rramakrishnan2",
      "author_url": "",
      "post_date": "10/04/2020 02:43:01",
      "content": "<p>When rerunning the notebook for private dataset, is the kernel restarted? does the output folder get refreshed?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1055823,
      "author_name": "vadim2011",
      "author_url": "",
      "post_date": "10/21/2020 06:22:04",
      "content": "<p>test comment</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1006852": "We just published a page to describe the classes of errors you might receive in code competitions, as well as a few tips to avoid/debug errors:\n\nhttps://www.kaggle.com/code-competition-debugging\n\nPlease take a look if you are currently stuck and feel free to share this if you see others who might benefit. Finally, a huge thanks to the folks that have been helping out fellow Kagglers with solving their errors!",
    "1010412": "Scoring submission may have some error. It is almost 3 hours since I submit my output. It takes only 20 minutes to run my code. However it is taking  over 2hours and still scoring. Is it server issue?",
    "1010573": "interactive notebook only has 5 patients in the test set. Submitted notebook has about 200 to review. So expect it to take about 40 times longer, depending on your model.",
    "1019670": "thanks @richardepstein , your comment helped me and now I have made my submission faster",
    "1020248": "I read https://www.kaggle.com/code-competition-debugging but there's still a point I'm not sure about:\nWhen I do a \"Submit Predictions\", is my script run against the entire hidden test set (public and private), and the score on the public portion displayed on the leaderboard, or is it run only on the public portion, and then run on the private portion when the contest is finished? If the latter, then it would be possible for the script to succeed during the contest period but fail in final scoring because of running out of RAM or time, etc.",
    "1021130": "dslate Good question - When you \"Submit Predictions,\" your code is run synchronously against the entire public + hidden private test sets. Therefore, in this competition, a successful submission on the public leaderboard indicates it also succeeded on the private. So if your submission returns an error, then it could have been attributable to an error on the private side of the re-run.",
    "1021144": "juliaelliott Thanks, that makes sense.",
    "1032348": "juliaelliott, would it be possible to provide some error log to help debugging ?",
    "1033030": "joejeo1 No, unfortunately we cannot provide any more detail on the private runs. This is because doing so runs the risk of being used for error-probing.",
    "1036136": "How  to install a R package and be able to submit a code, without internet access?  We have to use only those packages already in Kaggle's?\nThankyou!",
    "1036587": "When rerunning the notebook for private dataset, is the kernel restarted? does the output folder get refreshed?",
    "1037179": "See this notebook by CoreyLevinson, it worked for me: https://www.kaggle.com/returnofsputnik/how-to-use-external-uploaded-r-libraries-on-kaggle/",
    "1055823": "test comment"
  },
  "source": "meta"
}