{
  "id": 92680,
  "title": "What is the meaning of \"Failed. Exited with code 137.\"?",
  "url": "/competitions/imet-2019-fgvc6/discussion/92680",
  "author_name": "",
  "post_date": "2019-05-19T09:20:56.696281800Z",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>I wanted to use four GPU kernel to train each folds, so, I made four kernels and committed.\nBut, all kernels stopped with the message \"Failed. Exited with code 137.\" after 32000 seconds.</p>\n\n<p>Do you know the meaning of the message? </p>\n\n<p>And, is it possible to use four GPU kernel at the same time?\nIn other words,  4 commits at the same time.</p>\n\n<p>Thanks!</p>",
  "messages": [
    {
      "id": "533448",
      "postDate": "05/19/2019 09:20:56",
      "content": "<p>I wanted to use four GPU kernel to train each folds, so, I made four kernels and committed.\nBut, all kernels stopped with the message \"Failed. Exited with code 137.\" after 32000 seconds.</p>\n\n<p>Do you know the meaning of the message? </p>\n\n<p>And, is it possible to use four GPU kernel at the same time?\nIn other words,  4 commits at the same time.</p>\n\n<p>Thanks!</p>",
      "rawMarkdown": "I wanted to use four GPU kernel to train each folds, so, I made four kernels and committed.\nBut, all kernels stopped with the message \"Failed. Exited with code 137.\" after 32000 seconds.\n\nDo you know the meaning of the message? \n\nAnd, is it possible to use four GPU kernel at the same time?\nIn other words,  4 commits at the same time.\n\nThanks!",
      "votes": null
    },
    {
      "id": "533480",
      "postDate": "05/19/2019 10:52:20",
      "content": "<p>Maybe your code execution time more than 32000 seconds</p>",
      "rawMarkdown": "Maybe your code execution time more than 32000 seconds",
      "votes": null
    },
    {
      "id": "533513",
      "postDate": "05/19/2019 12:07:49",
      "content": "<p>Hi YouHan, do you mean committing 4 separate kernels  (or 4 versions of the same kernel) at the same time? </p>\n\n<p>If that is correct, then yes you can.</p>",
      "rawMarkdown": "Hi YouHan, do you mean committing 4 separate kernels  (or 4 versions of the same kernel) at the same time? \n\nIf that is correct, then yes you can.",
      "votes": null
    },
    {
      "id": "533584",
      "postDate": "05/19/2019 14:54:16",
      "content": "<p>Kernel time limit is 9 hours. It's not 32000 seconds, because I had a kernel which ran for 32231.2s successfully. But it's pretty close, so I think you hit the limit.</p>",
      "rawMarkdown": "Kernel time limit is 9 hours. It's not 32000 seconds, because I had a kernel which ran for 32231.2s successfully. But it's pretty close, so I think you hit the limit.",
      "votes": null
    },
    {
      "id": "534322",
      "postDate": "05/21/2019 04:26:16",
      "content": "<p>As you said, my code exceeded the 9 hours limit. \nThe kernel with small epochs was successful! Thanks!</p>",
      "rawMarkdown": "As you said, my code exceeded the 9 hours limit. \nThe kernel with small epochs was successful! Thanks!",
      "votes": null
    },
    {
      "id": "534323",
      "postDate": "05/21/2019 04:26:43",
      "content": "<p>You're right. I realized that my code exceeded the 9 hours  limit. \nThe kernel with small epochs was successful! Thanks!</p>",
      "rawMarkdown": "You're right. I realized that my code exceeded the 9 hours  limit. \nThe kernel with small epochs was successful! Thanks!",
      "votes": null
    },
    {
      "id": "534324",
      "postDate": "05/21/2019 04:27:45",
      "content": "<p>Yes. I'm running 4 separate kernels at the same time. Actually, I chose the 4 -fold system :)</p>",
      "rawMarkdown": "Yes. I'm running 4 separate kernels at the same time. Actually, I chose the 4 -fold system :)",
      "votes": null
    },
    {
      "id": "534948",
      "postDate": "05/22/2019 05:24:04",
      "content": "<p>In the last few days I have also encountered some technical glitches with kernel function ,unable to commit stack kernel</p>",
      "rawMarkdown": "In the last few days I have also encountered some technical glitches with kernel function ,unable to commit stack kernel",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 533480,
      "author_name": "timmmmmms",
      "author_url": "",
      "post_date": "05/19/2019 10:52:20",
      "content": "<p>Maybe your code execution time more than 32000 seconds</p>",
      "votes": null,
      "replies": [
        {
          "id": 534322,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "05/21/2019 04:26:16",
          "content": "<p>As you said, my code exceeded the 9 hours limit. \nThe kernel with small epochs was successful! Thanks!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 533513,
      "author_name": "ratthachat",
      "author_url": "",
      "post_date": "05/19/2019 12:07:49",
      "content": "<p>Hi YouHan, do you mean committing 4 separate kernels  (or 4 versions of the same kernel) at the same time? </p>\n\n<p>If that is correct, then yes you can.</p>",
      "votes": null,
      "replies": [
        {
          "id": 534324,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "05/21/2019 04:27:45",
          "content": "<p>Yes. I'm running 4 separate kernels at the same time. Actually, I chose the 4 -fold system :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 533584,
      "author_name": "artyomp",
      "author_url": "",
      "post_date": "05/19/2019 14:54:16",
      "content": "<p>Kernel time limit is 9 hours. It's not 32000 seconds, because I had a kernel which ran for 32231.2s successfully. But it's pretty close, so I think you hit the limit.</p>",
      "votes": null,
      "replies": [
        {
          "id": 534323,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "05/21/2019 04:26:43",
          "content": "<p>You're right. I realized that my code exceeded the 9 hours  limit. \nThe kernel with small epochs was successful! Thanks!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 534948,
      "author_name": "econdata",
      "author_url": "",
      "post_date": "05/22/2019 05:24:04",
      "content": "<p>In the last few days I have also encountered some technical glitches with kernel function ,unable to commit stack kernel</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "533448": "I wanted to use four GPU kernel to train each folds, so, I made four kernels and committed.\nBut, all kernels stopped with the message \"Failed. Exited with code 137.\" after 32000 seconds.\n\nDo you know the meaning of the message? \n\nAnd, is it possible to use four GPU kernel at the same time?\nIn other words,  4 commits at the same time.\n\nThanks!",
    "533480": "Maybe your code execution time more than 32000 seconds",
    "533513": "Hi YouHan, do you mean committing 4 separate kernels  (or 4 versions of the same kernel) at the same time? \n\nIf that is correct, then yes you can.",
    "533584": "Kernel time limit is 9 hours. It's not 32000 seconds, because I had a kernel which ran for 32231.2s successfully. But it's pretty close, so I think you hit the limit.",
    "534322": "As you said, my code exceeded the 9 hours limit. \nThe kernel with small epochs was successful! Thanks!",
    "534323": "You're right. I realized that my code exceeded the 9 hours  limit. \nThe kernel with small epochs was successful! Thanks!",
    "534324": "Yes. I'm running 4 separate kernels at the same time. Actually, I chose the 4 -fold system :)",
    "534948": "In the last few days I have also encountered some technical glitches with kernel function ,unable to commit stack kernel"
  },
  "source": "meta"
}