{
  "id": 68881,
  "title": "Timeout during Commit",
  "url": "/competitions/airbus-ship-detection/discussion/68881",
  "author_name": "",
  "post_date": "2018-10-18T05:50:55.136261200Z",
  "votes": null,
  "comment_count": 6,
  "views": 0,
  "content": "<p>Hi \nI view the below message in log. it is for this reason at the end of commit i cant view the validation loss /metrics at the end of epoch .\nCan you please tell why is the timeout happening ,this is causing trouble in determining how well did training go....</p>\n\n<p>[NbConvertApp] Executing notebook with kernel: python3\n16106.7s\n3\n[NbConvertApp] WARNING | Timeout waiting for IOPub output</p>",
  "messages": [
    {
      "id": "405789",
      "postDate": "10/18/2018 05:50:55",
      "content": "<p>Hi \nI view the below message in log. it is for this reason at the end of commit i cant view the validation loss /metrics at the end of epoch .\nCan you please tell why is the timeout happening ,this is causing trouble in determining how well did training go....</p>\n\n<p>[NbConvertApp] Executing notebook with kernel: python3\n16106.7s\n3\n[NbConvertApp] WARNING | Timeout waiting for IOPub output</p>",
      "rawMarkdown": "Hi \nI view the below message in log. it is for this reason at the end of commit i cant view the validation loss /metrics at the end of epoch .\nCan you please tell why is the timeout happening ,this is causing trouble in determining how well did training go....\n\n[NbConvertApp] Executing notebook with kernel: python3\n16106.7s\n3\n[NbConvertApp] WARNING | Timeout waiting for IOPub output",
      "votes": null
    },
    {
      "id": "405790",
      "postDate": "10/18/2018 05:51:29",
      "content": "<p>bascially the output stops getting printed after some duration of time... </p>",
      "rawMarkdown": "bascially the output stops getting printed after some duration of time...",
      "votes": null
    },
    {
      "id": "405791",
      "postDate": "10/18/2018 05:56:21",
      "content": "<p>Program does completes successfully before 6 hrs time limit however out put stops getting updated in notebook after 2 to 3 hours of run... how to over come this painpoint</p>",
      "rawMarkdown": "Program does completes successfully before 6 hrs time limit however out put stops getting updated in notebook after 2 to 3 hours of run... how to over come this painpoint",
      "votes": null
    },
    {
      "id": "406653",
      "postDate": "10/19/2018 15:25:26",
      "content": "<p>You can try printing into a file</p>",
      "rawMarkdown": "You can try printing into a file",
      "votes": null
    },
    {
      "id": "406711",
      "postDate": "10/19/2018 17:52:03",
      "content": "<p>Thanks ,no issues i used learn.validation_losses ,train losses  in print\n,btw is there any change in time out for running kernel... its been 7 hours my kernel continues to run interactive session</p>",
      "rawMarkdown": "Thanks ,no issues i used learn.validation_losses ,train losses  in print\n,btw is there any change in time out for running kernel... its been 7 hours my kernel continues to run interactive session",
      "votes": null
    },
    {
      "id": "406731",
      "postDate": "10/19/2018 18:20:24",
      "content": "<p>I'm not exactly sure, recently one of my kernels on salt segmentation ran ~6.15 hours.</p>",
      "rawMarkdown": "I'm not exactly sure, recently one of my kernels on salt segmentation ran ~6.15 hours.",
      "votes": null
    },
    {
      "id": "533075",
      "postDate": "05/18/2019 12:01:18",
      "content": "<p>For People who has this issue, it's not a problem since the epochs are all done . You can see the history of the training and plot it, shows you that it had been trained until the last epoch</p>",
      "rawMarkdown": "For People who has this issue, it's not a problem since the epochs are all done . You can see the history of the training and plot it, shows you that it had been trained until the last epoch",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 405790,
      "author_name": "jaideepvalani",
      "author_url": "",
      "post_date": "10/18/2018 05:51:29",
      "content": "<p>bascially the output stops getting printed after some duration of time... </p>",
      "votes": null,
      "replies": [
        {
          "id": 405791,
          "author_name": "jaideepvalani",
          "author_url": "",
          "post_date": "10/18/2018 05:56:21",
          "content": "<p>Program does completes successfully before 6 hrs time limit however out put stops getting updated in notebook after 2 to 3 hours of run... how to over come this painpoint</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 406653,
          "author_name": "iafoss",
          "author_url": "",
          "post_date": "10/19/2018 15:25:26",
          "content": "<p>You can try printing into a file</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 406711,
          "author_name": "jaideepvalani",
          "author_url": "",
          "post_date": "10/19/2018 17:52:03",
          "content": "<p>Thanks ,no issues i used learn.validation_losses ,train losses  in print\n,btw is there any change in time out for running kernel... its been 7 hours my kernel continues to run interactive session</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 406731,
          "author_name": "iafoss",
          "author_url": "",
          "post_date": "10/19/2018 18:20:24",
          "content": "<p>I'm not exactly sure, recently one of my kernels on salt segmentation ran ~6.15 hours.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 533075,
      "author_name": "alkelani",
      "author_url": "",
      "post_date": "05/18/2019 12:01:18",
      "content": "<p>For People who has this issue, it's not a problem since the epochs are all done . You can see the history of the training and plot it, shows you that it had been trained until the last epoch</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "405789": "Hi \nI view the below message in log. it is for this reason at the end of commit i cant view the validation loss /metrics at the end of epoch .\nCan you please tell why is the timeout happening ,this is causing trouble in determining how well did training go....\n\n[NbConvertApp] Executing notebook with kernel: python3\n16106.7s\n3\n[NbConvertApp] WARNING | Timeout waiting for IOPub output",
    "405790": "bascially the output stops getting printed after some duration of time...",
    "405791": "Program does completes successfully before 6 hrs time limit however out put stops getting updated in notebook after 2 to 3 hours of run... how to over come this painpoint",
    "406653": "You can try printing into a file",
    "406711": "Thanks ,no issues i used learn.validation_losses ,train losses  in print\n,btw is there any change in time out for running kernel... its been 7 hours my kernel continues to run interactive session",
    "406731": "I'm not exactly sure, recently one of my kernels on salt segmentation ran ~6.15 hours.",
    "533075": "For People who has this issue, it's not a problem since the epochs are all done . You can see the history of the training and plot it, shows you that it had been trained until the last epoch"
  },
  "source": "meta"
}