{
  "id": 216980,
  "title": "Error: 'Your notebook tried to allocate more memory than is available. It has restarted.'",
  "url": "/competitions/cassava-leaf-disease-classification/discussion/216980",
  "author_name": "",
  "post_date": "2021-02-04T18:53:45.189501100Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi all,<br>\nI am getting the error </p>\n<p>'Your notebook tried to allocate more memory than is available. It has restarted.'</p>\n<p>while trying to  load the 21.4K images. Tried to load them in batches but still getting the same error. Any lead is appreciated. Thanks in advance.</p>",
  "messages": [
    {
      "id": "1186317",
      "postDate": "02/04/2021 18:53:45",
      "content": "<p>Hi all,<br>\nI am getting the error </p>\n<p>'Your notebook tried to allocate more memory than is available. It has restarted.'</p>\n<p>while trying to  load the 21.4K images. Tried to load them in batches but still getting the same error. Any lead is appreciated. Thanks in advance.</p>",
      "rawMarkdown": "Hi all,\nI am getting the error \n\n'Your notebook tried to allocate more memory than is available. It has restarted.'\n\n while trying to  load the 21.4K images. Tried to load them in batches but still getting the same error. Any lead is appreciated. Thanks in advance.",
      "votes": null
    },
    {
      "id": "1186439",
      "postDate": "02/04/2021 20:27:15",
      "content": "<p>Hello, </p>\n<p>I recommande you this discussion </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/questions-and-answers/148011\" target=\"_blank\">How To Fix Your Notebook tried to allocate more memory than available. It has been restarted</a></li>\n</ul>",
      "rawMarkdown": "Hello, \n\nI recommande you this discussion \n- [How To Fix Your Notebook tried to allocate more memory than available. It has been restarted](https://www.kaggle.com/questions-and-answers/148011)",
      "votes": null
    },
    {
      "id": "1186450",
      "postDate": "02/04/2021 20:34:50",
      "content": "<p>You don't need to load the whole data at once. Use batch Dataloader instead. </p>",
      "rawMarkdown": "You don't need to load the whole data at once. Use batch Dataloader instead.",
      "votes": null
    },
    {
      "id": "1187056",
      "postDate": "02/05/2021 07:39:45",
      "content": "<p>I was also getting this error, it was due to my shuffle function. I was passing huge buffer size inside <br>\n<code>dataset.shuffle()</code></p>",
      "rawMarkdown": "I was also getting this error, it was due to my shuffle function. I was passing huge buffer size inside \n`dataset.shuffle()`",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1186439,
      "author_name": "milobele",
      "author_url": "",
      "post_date": "02/04/2021 20:27:15",
      "content": "<p>Hello, </p>\n<p>I recommande you this discussion </p>\n<ul>\n<li><a href=\"https://www.kaggle.com/questions-and-answers/148011\" target=\"_blank\">How To Fix Your Notebook tried to allocate more memory than available. It has been restarted</a></li>\n</ul>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1186450,
      "author_name": "serigne",
      "author_url": "",
      "post_date": "02/04/2021 20:34:50",
      "content": "<p>You don't need to load the whole data at once. Use batch Dataloader instead. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1187056,
      "author_name": "shubham219",
      "author_url": "",
      "post_date": "02/05/2021 07:39:45",
      "content": "<p>I was also getting this error, it was due to my shuffle function. I was passing huge buffer size inside <br>\n<code>dataset.shuffle()</code></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1186317": "Hi all,\nI am getting the error \n\n'Your notebook tried to allocate more memory than is available. It has restarted.'\n\n while trying to  load the 21.4K images. Tried to load them in batches but still getting the same error. Any lead is appreciated. Thanks in advance.",
    "1186439": "Hello, \n\nI recommande you this discussion \n- [How To Fix Your Notebook tried to allocate more memory than available. It has been restarted](https://www.kaggle.com/questions-and-answers/148011)",
    "1186450": "You don't need to load the whole data at once. Use batch Dataloader instead.",
    "1187056": "I was also getting this error, it was due to my shuffle function. I was passing huge buffer size inside \n`dataset.shuffle()`"
  },
  "source": "meta"
}