{
  "id": 205800,
  "title": "submission timeout",
  "url": "/competitions/hubmap-kidney-segmentation/discussion/205800",
  "author_name": "",
  "post_date": "2020-12-21T22:32:57.784471Z",
  "votes": 3,
  "comment_count": 4,
  "views": 0,
  "content": "<p>I am wondering if anyone else is experiencing this: the inference notebook runs on the public test dataset in about 40 minutes. Saving it also works fine (the notebook is re-run during the saving for whatever reason). However the submission times out after the 9 hour limit. It's the same code which handles the public set just fine. I am very puzzled what could be so different about the private set.</p>",
  "messages": [
    {
      "id": "1121772",
      "postDate": "12/21/2020 22:32:57",
      "content": "<p>I am wondering if anyone else is experiencing this: the inference notebook runs on the public test dataset in about 40 minutes. Saving it also works fine (the notebook is re-run during the saving for whatever reason). However the submission times out after the 9 hour limit. It's the same code which handles the public set just fine. I am very puzzled what could be so different about the private set.</p>",
      "rawMarkdown": "I am wondering if anyone else is experiencing this: the inference notebook runs on the public test dataset in about 40 minutes. Saving it also works fine (the notebook is re-run during the saving for whatever reason). However the submission times out after the 9 hour limit. It's the same code which handles the public set just fine. I am very puzzled what could be so different about the private set.",
      "votes": null
    },
    {
      "id": "1121806",
      "postDate": "12/21/2020 23:24:14",
      "content": "<p>You might run into memory issue. Private test images seem larger than public ones. It happened to me and that's why I changed my team name to RAM error again 😂</p>",
      "rawMarkdown": "You might run into memory issue. Private test images seem larger than public ones. It happened to me and that's why I changed my team name to RAM error again 😂",
      "votes": null
    },
    {
      "id": "1121813",
      "postDate": "12/21/2020 23:41:41",
      "content": "<p>Hmm, that's a good point. But shouldn't the error message be different if it crashes due to OOM during the submission run?</p>",
      "rawMarkdown": "Hmm, that's a good point. But shouldn't the error message be different if it crashes due to OOM during the submission run?",
      "votes": null
    },
    {
      "id": "1123174",
      "postDate": "12/23/2020 01:45:16",
      "content": "<p>I do believe you were correct about the memory issue. Once I reduced the batch size the submission went through. Thank you for the advice!</p>",
      "rawMarkdown": "I do believe you were correct about the memory issue. Once I reduced the batch size the submission went through. Thank you for the advice!",
      "votes": null
    },
    {
      "id": "1123616",
      "postDate": "12/23/2020 11:25:07",
      "content": "<p>Check for unused variables. Try deleting those. <a href=\"https://www.kaggle.com/igor14497\" target=\"_blank\">@igor14497</a> </p>",
      "rawMarkdown": "Check for unused variables. Try deleting those. @igor14497",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1121806,
      "author_name": "jihangz",
      "author_url": "",
      "post_date": "12/21/2020 23:24:14",
      "content": "<p>You might run into memory issue. Private test images seem larger than public ones. It happened to me and that's why I changed my team name to RAM error again 😂</p>",
      "votes": null,
      "replies": [
        {
          "id": 1123174,
          "author_name": "igor14497",
          "author_url": "",
          "post_date": "12/23/2020 01:45:16",
          "content": "<p>I do believe you were correct about the memory issue. Once I reduced the batch size the submission went through. Thank you for the advice!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1121813,
      "author_name": "igor14497",
      "author_url": "",
      "post_date": "12/21/2020 23:41:41",
      "content": "<p>Hmm, that's a good point. But shouldn't the error message be different if it crashes due to OOM during the submission run?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1123616,
      "author_name": "saurabhshahane",
      "author_url": "",
      "post_date": "12/23/2020 11:25:07",
      "content": "<p>Check for unused variables. Try deleting those. <a href=\"https://www.kaggle.com/igor14497\" target=\"_blank\">@igor14497</a> </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1121772": "I am wondering if anyone else is experiencing this: the inference notebook runs on the public test dataset in about 40 minutes. Saving it also works fine (the notebook is re-run during the saving for whatever reason). However the submission times out after the 9 hour limit. It's the same code which handles the public set just fine. I am very puzzled what could be so different about the private set.",
    "1121806": "You might run into memory issue. Private test images seem larger than public ones. It happened to me and that's why I changed my team name to RAM error again 😂",
    "1121813": "Hmm, that's a good point. But shouldn't the error message be different if it crashes due to OOM during the submission run?",
    "1123174": "I do believe you were correct about the memory issue. Once I reduced the batch size the submission went through. Thank you for the advice!",
    "1123616": "Check for unused variables. Try deleting those. @igor14497"
  },
  "source": "meta"
}