{
  "id": 506639,
  "title": "Memory limit and load the data",
  "url": "/competitions/leash-BELKA/discussion/506639",
  "author_name": "",
  "post_date": "2024-05-22T15:45:47.638185400Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I face the problem of memory limit while I load the training data. How can I solve this issue?</p>",
  "messages": [
    {
      "id": "2829466",
      "postDate": "05/22/2024 15:45:47",
      "content": "<p>I face the problem of memory limit while I load the training data. How can I solve this issue?</p>",
      "rawMarkdown": "I face the problem of memory limit while I load the training data. How can I solve this issue?",
      "votes": null
    },
    {
      "id": "2829699",
      "postDate": "05/22/2024 18:31:32",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/alkahwaji\" target=\"_blank\">@alkahwaji</a> <br>\nuse data_generator instead of loading your data at once in memory, it use  batches and divide  the data above those batches <br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8861763%2F9507e0874080b0e1c48a35422f096599%2FCapture.PNG?generation=1716402642172163&amp;alt=media\"></p>",
      "rawMarkdown": "Hi @alkahwaji \nuse data_generator instead of loading your data at once in memory, it use  batches and divide  the data above those batches \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8861763%2F9507e0874080b0e1c48a35422f096599%2FCapture.PNG?generation=1716402642172163&alt=media)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2829699,
      "author_name": "esraatahersaad",
      "author_url": "",
      "post_date": "05/22/2024 18:31:32",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/alkahwaji\" target=\"_blank\">@alkahwaji</a> <br>\nuse data_generator instead of loading your data at once in memory, it use  batches and divide  the data above those batches <br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8861763%2F9507e0874080b0e1c48a35422f096599%2FCapture.PNG?generation=1716402642172163&amp;alt=media\"></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2829466": "I face the problem of memory limit while I load the training data. How can I solve this issue?",
    "2829699": "Hi @alkahwaji \nuse data_generator instead of loading your data at once in memory, it use  batches and divide  the data above those batches \n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F8861763%2F9507e0874080b0e1c48a35422f096599%2FCapture.PNG?generation=1716402642172163&alt=media)"
  },
  "source": "meta"
}