{
  "id": 238751,
  "title": "How to know if your private submissions will fail when public scored and succeeded",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/238751",
  "author_name": "something4kag",
  "post_date": "2021-05-13T10:06:03.824000",
  "votes": 5,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I do think changing from notebook to script by using File - &gt; Editor Type -&gt; Script and using that for submissions once you have a working version should help.  It should fail totally if anything fails as there are no cells. Then under your submissions it should see <em>Notebook Threw Exception Error.</em></p>\n<p>This is an example I just ran to test as a script instead of a notebook. Both Public and Private have error. Previously Public as a notebook would have a score and Status Succeeded. Script will commit fine with no errors and once you have that then submit the csv as you normally do.</p>\n<hr>\n<p>Submission and Description      Status                Private Score Public Score    Use for Final Score<br>\nHuBMAP sub s2v3 script     Notebook Threw Exception Error Error<br>\n(version 5/5)<br>\n37 minutes ago by something4kag </p>\n<p>You can test one of your 0 private score notebooks to see if this helps identify your errors and know that you have options in future for finding out before competition ends that your private test will fail.</p>\n<p>If you have any ! type commands like !pip install… change to <br>\nimport os<br>\nos.system('pip install …')<br>\nalso comment out any displays of dataframes, you will get an error anyways on the script in commit.  </p>",
  "messages": [
    {
      "id": 1305486,
      "postDate": "2021-05-13T10:06:03.823Z",
      "content": "<p>I do think changing from notebook to script by using File - &gt; Editor Type -&gt; Script and using that for submissions once you have a working version should help.  It should fail totally if anything fails as there are no cells. Then under your submissions it should see <em>Notebook Threw Exception Error.</em></p>\n<p>This is an example I just ran to test as a script instead of a notebook. Both Public and Private have error. Previously Public as a notebook would have a score and Status Succeeded. Script will commit fine with no errors and once you have that then submit the csv as you normally do.</p>\n<hr>\n<p>Submission and Description      Status                Private Score Public Score    Use for Final Score<br>\nHuBMAP sub s2v3 script     Notebook Threw Exception Error Error<br>\n(version 5/5)<br>\n37 minutes ago by something4kag </p>\n<p>You can test one of your 0 private score notebooks to see if this helps identify your errors and know that you have options in future for finding out before competition ends that your private test will fail.</p>\n<p>If you have any ! type commands like !pip install… change to <br>\nimport os<br>\nos.system('pip install …')<br>\nalso comment out any displays of dataframes, you will get an error anyways on the script in commit.  </p>",
      "rawMarkdown": "I do think changing from notebook to script by using File - > Editor Type -> Script and using that for submissions once you have a working version should help.  It should fail totally if anything fails as there are no cells. Then under your submissions it should see *Notebook Threw Exception Error.*\n\nThis is an example I just ran to test as a script instead of a notebook. Both Public and Private have error. Previously Public as a notebook would have a score and Status Succeeded. Script will commit fine with no errors and once you have that then submit the csv as you normally do.\n\n--------------------------------------------------------------------------------------------------\nSubmission and Description      Status                Private Score Public Score    Use for Final Score\nHuBMAP sub s2v3 script     Notebook Threw Exception Error Error\n(version 5/5)\n37 minutes ago by something4kag \n\nYou can test one of your 0 private score notebooks to see if this helps identify your errors and know that you have options in future for finding out before competition ends that your private test will fail.\n\nIf you have any ! type commands like !pip install... change to \nimport os\nos.system('pip install ...')\nalso comment out any displays of dataframes, you will get an error anyways on the script in commit.  ",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1305486": "I do think changing from notebook to script by using File - > Editor Type -> Script and using that for submissions once you have a working version should help.  It should fail totally if anything fails as there are no cells. Then under your submissions it should see *Notebook Threw Exception Error.*\n\nThis is an example I just ran to test as a script instead of a notebook. Both Public and Private have error. Previously Public as a notebook would have a score and Status Succeeded. Script will commit fine with no errors and once you have that then submit the csv as you normally do.\n\n--------------------------------------------------------------------------------------------------\nSubmission and Description      Status                Private Score Public Score    Use for Final Score\nHuBMAP sub s2v3 script     Notebook Threw Exception Error Error\n(version 5/5)\n37 minutes ago by something4kag \n\nYou can test one of your 0 private score notebooks to see if this helps identify your errors and know that you have options in future for finding out before competition ends that your private test will fail.\n\nIf you have any ! type commands like !pip install... change to \nimport os\nos.system('pip install ...')\nalso comment out any displays of dataframes, you will get an error anyways on the script in commit.  "
  }
}