{
  "id": 278545,
  "title": "Problem in submitting the jupyter notebook.",
  "url": "/competitions/rsna-miccai-brain-tumor-radiogenomic-classification/discussion/278545",
  "author_name": "",
  "post_date": "2021-10-14T18:01:39.199984200Z",
  "votes": 4,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hello,</p>\n<p>All these days, we used to test our networks internally and upload the predictions to obtain the AUC value. <br>\nNow we have put together all our processing pieces and made it a pipeline to submit for the final testing phase. <br>\nWhen we run this pipeline on a subsample of the validation data, it runs successfully. However, when we run it on all the cases, we are facing errors. </p>\n<p>The error we get is \"Notebook Threw Exception\".<br>\nThe description of the error as on the website is \"Notebook Threw Exception: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset\".</p>\n<p>Can someone please help us in this regard ?</p>",
  "messages": [
    {
      "id": "1544855",
      "postDate": "10/14/2021 18:01:39",
      "content": "<p>Hello,</p>\n<p>All these days, we used to test our networks internally and upload the predictions to obtain the AUC value. <br>\nNow we have put together all our processing pieces and made it a pipeline to submit for the final testing phase. <br>\nWhen we run this pipeline on a subsample of the validation data, it runs successfully. However, when we run it on all the cases, we are facing errors. </p>\n<p>The error we get is \"Notebook Threw Exception\".<br>\nThe description of the error as on the website is \"Notebook Threw Exception: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset\".</p>\n<p>Can someone please help us in this regard ?</p>",
      "rawMarkdown": "Hello,\n\nAll these days, we used to test our networks internally and upload the predictions to obtain the AUC value. \nNow we have put together all our processing pieces and made it a pipeline to submit for the final testing phase. \nWhen we run this pipeline on a subsample of the validation data, it runs successfully. However, when we run it on all the cases, we are facing errors. \n\nThe error we get is \"Notebook Threw Exception\".\nThe description of the error as on the website is \"Notebook Threw Exception: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset\".\n\nCan someone please help us in this regard ?",
      "votes": null
    },
    {
      "id": "1545769",
      "postDate": "10/15/2021 14:40:52",
      "content": "<p>I was facing the same problem today. I made a pipeline which contains ensemble of around 10 models and it was running  fine when saved and run. But in submission I got notebook error. I tried to freed GPU, RAM etc. After every model prediction. But it not helped me. At last I removed 4 models from my final ensemble submission notebook. Then it worked.</p>",
      "rawMarkdown": "I was facing the same problem today. I made a pipeline which contains ensemble of around 10 models and it was running  fine when saved and run. But in submission I got notebook error. I tried to freed GPU, RAM etc. After every model prediction. But it not helped me. At last I removed 4 models from my final ensemble submission notebook. Then it worked.",
      "votes": null
    },
    {
      "id": "1545832",
      "postDate": "10/15/2021 15:59:22",
      "content": "<p>I had the same problem today at the wrong time.<br>\n\"Notebook Threw Exception\"</p>\n<p>In my case, I have an ensemble with 20 models.<br>\nI felt it wasn't a hardware issue as I made the mini-batch size so small that it didn't exceed the GPU memory.</p>",
      "rawMarkdown": "I had the same problem today at the wrong time.\n\"Notebook Threw Exception\"\n\nIn my case, I have an ensemble with 20 models.\nI felt it wasn't a hardware issue as I made the mini-batch size so small that it didn't exceed the GPU memory.",
      "votes": null
    },
    {
      "id": "1545970",
      "postDate": "10/15/2021 18:12:26",
      "content": "<p>I learned this the hard way: always test your code end2end on kaggle one week before the deadline. i missed two deadlines this year (birdcall and moa). both were silver solutions..  </p>",
      "rawMarkdown": "I learned this the hard way: always test your code end2end on kaggle one week before the deadline. i missed two deadlines this year (birdcall and moa). both were silver solutions..",
      "votes": null
    },
    {
      "id": "1545977",
      "postDate": "10/15/2021 18:15:44",
      "content": "<p>Thanks for the reply. I just have one model. I am not doing any ensembling at all.</p>",
      "rawMarkdown": "Thanks for the reply. I just have one model. I am not doing any ensembling at all.",
      "votes": null
    },
    {
      "id": "1545980",
      "postDate": "10/15/2021 18:18:13",
      "content": "<p>Thanks for the reply. In my case, I suspect the algorithm to be running as I can see it take the same time as it took during regular testing. </p>",
      "rawMarkdown": "Thanks for the reply. In my case, I suspect the algorithm to be running as I can see it take the same time as it took during regular testing.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1545769,
      "author_name": "boltuzamaki",
      "author_url": "",
      "post_date": "10/15/2021 14:40:52",
      "content": "<p>I was facing the same problem today. I made a pipeline which contains ensemble of around 10 models and it was running  fine when saved and run. But in submission I got notebook error. I tried to freed GPU, RAM etc. After every model prediction. But it not helped me. At last I removed 4 models from my final ensemble submission notebook. Then it worked.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1545977,
          "author_name": "teamalpaca",
          "author_url": "",
          "post_date": "10/15/2021 18:15:44",
          "content": "<p>Thanks for the reply. I just have one model. I am not doing any ensembling at all.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1545832,
      "author_name": "hideyukizushi",
      "author_url": "",
      "post_date": "10/15/2021 15:59:22",
      "content": "<p>I had the same problem today at the wrong time.<br>\n\"Notebook Threw Exception\"</p>\n<p>In my case, I have an ensemble with 20 models.<br>\nI felt it wasn't a hardware issue as I made the mini-batch size so small that it didn't exceed the GPU memory.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1545980,
          "author_name": "teamalpaca",
          "author_url": "",
          "post_date": "10/15/2021 18:18:13",
          "content": "<p>Thanks for the reply. In my case, I suspect the algorithm to be running as I can see it take the same time as it took during regular testing. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1545970,
      "author_name": "",
      "author_url": "",
      "post_date": "10/15/2021 18:12:26",
      "content": "<p>I learned this the hard way: always test your code end2end on kaggle one week before the deadline. i missed two deadlines this year (birdcall and moa). both were silver solutions..  </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1544855": "Hello,\n\nAll these days, we used to test our networks internally and upload the predictions to obtain the AUC value. \nNow we have put together all our processing pieces and made it a pipeline to submit for the final testing phase. \nWhen we run this pipeline on a subsample of the validation data, it runs successfully. However, when we run it on all the cases, we are facing errors. \n\nThe error we get is \"Notebook Threw Exception\".\nThe description of the error as on the website is \"Notebook Threw Exception: While rerunning your code, your notebook hit an unhandled error. Note that the hidden dataset can be larger/smaller/different than the public dataset\".\n\nCan someone please help us in this regard ?",
    "1545769": "I was facing the same problem today. I made a pipeline which contains ensemble of around 10 models and it was running  fine when saved and run. But in submission I got notebook error. I tried to freed GPU, RAM etc. After every model prediction. But it not helped me. At last I removed 4 models from my final ensemble submission notebook. Then it worked.",
    "1545832": "I had the same problem today at the wrong time.\n\"Notebook Threw Exception\"\n\nIn my case, I have an ensemble with 20 models.\nI felt it wasn't a hardware issue as I made the mini-batch size so small that it didn't exceed the GPU memory.",
    "1545970": "I learned this the hard way: always test your code end2end on kaggle one week before the deadline. i missed two deadlines this year (birdcall and moa). both were silver solutions..",
    "1545977": "Thanks for the reply. I just have one model. I am not doing any ensembling at all.",
    "1545980": "Thanks for the reply. In my case, I suspect the algorithm to be running as I can see it take the same time as it took during regular testing."
  },
  "source": "meta"
}