{
  "id": 333514,
  "title": "cudaErrorMemoryAllocation out of memory",
  "url": "/competitions/amex-default-prediction/discussion/333514",
  "author_name": "",
  "post_date": "2022-06-27T02:36:13.357724600Z",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Although I use cudf to run all the data on the GPU and use gc.collect to release memory, I still encounter this problem. I am directly stuck in the data processing step. Do you have any better suggestions? 😯😯😯😯</p>",
  "messages": [
    {
      "id": "1834531",
      "postDate": "06/27/2022 02:36:13",
      "content": "<p>Although I use cudf to run all the data on the GPU and use gc.collect to release memory, I still encounter this problem. I am directly stuck in the data processing step. Do you have any better suggestions? 😯😯😯😯</p>",
      "rawMarkdown": "Although I use cudf to run all the data on the GPU and use gc.collect to release memory, I still encounter this problem. I am directly stuck in the data processing step. Do you have any better suggestions? 😯😯😯😯",
      "votes": null
    },
    {
      "id": "1834835",
      "postDate": "06/27/2022 08:17:58",
      "content": "<p>you are using cudf for data processing which uses GPU. How much RAM does your GPU have? this error indicates that it is not enough for your operations</p>",
      "rawMarkdown": "you are using cudf for data processing which uses GPU. How much RAM does your GPU have? this error indicates that it is not enough for your operations",
      "votes": null
    },
    {
      "id": "1834900",
      "postDate": "06/27/2022 09:40:21",
      "content": "<p>This may solve your problem: <br>\n<code>cudf.set_allocator(\"managed\")</code></p>\n<p><a href=\"https://github.com/rapidsai/cudf/issues/2288\" target=\"_blank\">https://github.com/rapidsai/cudf/issues/2288</a><br>\n<a href=\"https://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf\" target=\"_blank\">https://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf</a><br>\n<a href=\"https://github.com/rapidsai/cudf/issues/4921\" target=\"_blank\">https://github.com/rapidsai/cudf/issues/4921</a></p>",
      "rawMarkdown": "This may solve your problem: \n`cudf.set_allocator(\"managed\")`\n\nhttps://github.com/rapidsai/cudf/issues/2288\nhttps://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf\nhttps://github.com/rapidsai/cudf/issues/4921",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1834835,
      "author_name": "raddar",
      "author_url": "",
      "post_date": "06/27/2022 08:17:58",
      "content": "<p>you are using cudf for data processing which uses GPU. How much RAM does your GPU have? this error indicates that it is not enough for your operations</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1834900,
      "author_name": "mohammadrahmati",
      "author_url": "",
      "post_date": "06/27/2022 09:40:21",
      "content": "<p>This may solve your problem: <br>\n<code>cudf.set_allocator(\"managed\")</code></p>\n<p><a href=\"https://github.com/rapidsai/cudf/issues/2288\" target=\"_blank\">https://github.com/rapidsai/cudf/issues/2288</a><br>\n<a href=\"https://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf\" target=\"_blank\">https://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf</a><br>\n<a href=\"https://github.com/rapidsai/cudf/issues/4921\" target=\"_blank\">https://github.com/rapidsai/cudf/issues/4921</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1834531": "Although I use cudf to run all the data on the GPU and use gc.collect to release memory, I still encounter this problem. I am directly stuck in the data processing step. Do you have any better suggestions? 😯😯😯😯",
    "1834835": "you are using cudf for data processing which uses GPU. How much RAM does your GPU have? this error indicates that it is not enough for your operations",
    "1834900": "This may solve your problem: \n`cudf.set_allocator(\"managed\")`\n\nhttps://github.com/rapidsai/cudf/issues/2288\nhttps://stackoverflow.com/questions/65995943/reading-a-huge-csv-file-using-cudf\nhttps://github.com/rapidsai/cudf/issues/4921"
  },
  "source": "meta"
}