{
  "id": 388624,
  "title": "Missing cudf/cuml in the latest Kaggle environment ?",
  "url": "/competitions/predict-student-performance-from-game-play/discussion/388624",
  "author_name": "",
  "post_date": "2023-02-18T16:26:04.984715Z",
  "votes": 9,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I think there's no installation of cudf or cuml in the latest docker container. I can't use cudf/cuml with any GPU notebook (P100 and 2xT4). cupy is installed though. Has anyone faced the same problem recently?</p>\n<p>Below is the screenshot of the same:<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4359632%2Fc71239397074646ec90a1a99eae60779%2FScreenshot%202023-02-18%20at%209.54.24%20PM.png?generation=1676737534860229&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "2149745",
      "postDate": "02/18/2023 16:26:04",
      "content": "<p>I think there's no installation of cudf or cuml in the latest docker container. I can't use cudf/cuml with any GPU notebook (P100 and 2xT4). cupy is installed though. Has anyone faced the same problem recently?</p>\n<p>Below is the screenshot of the same:<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4359632%2Fc71239397074646ec90a1a99eae60779%2FScreenshot%202023-02-18%20at%209.54.24%20PM.png?generation=1676737534860229&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I think there's no installation of cudf or cuml in the latest docker container. I can't use cudf/cuml with any GPU notebook (P100 and 2xT4). cupy is installed though. Has anyone faced the same problem recently?\n\nBelow is the screenshot of the same:![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4359632%2Fc71239397074646ec90a1a99eae60779%2FScreenshot%202023-02-18%20at%209.54.24%20PM.png?generation=1676737534860229&alt=media)",
      "votes": null
    },
    {
      "id": "2149771",
      "postDate": "02/18/2023 16:52:24",
      "content": "<p>Hmm… this is weird, I have also just confirmed if we start a new GPU Kaggle notebook (inside or outside this specific competition) we cannot access RAPIDS cuDF nor cuML. For the time being, we need to fork an older notebook that uses GPU and keep it \"Pinned to original environment\". Then the GPU Kaggle notebook will use an older docker image and we can use RAPIDS. </p>\n<p>Phil ( <a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a> ), can you look into this? Thank you</p>",
      "rawMarkdown": "Hmm... this is weird, I have also just confirmed if we start a new GPU Kaggle notebook (inside or outside this specific competition) we cannot access RAPIDS cuDF nor cuML. For the time being, we need to fork an older notebook that uses GPU and keep it \"Pinned to original environment\". Then the GPU Kaggle notebook will use an older docker image and we can use RAPIDS. \n\nPhil ( @philculliton ), can you look into this? Thank you",
      "votes": null
    },
    {
      "id": "2149939",
      "postDate": "02/18/2023 19:50:41",
      "content": "<p>It seems they will be back soon. This <a href=\"https://github.com/Kaggle/docker-python/pull/1216/commits/9fc103b7328adfc694f72f25477b16e5499f3bd2\" target=\"_blank\">commit</a> added cudf and cuml back. If you check the latest docker image, cudf and cuml are also there <a href=\"https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97\" target=\"_blank\">https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97</a> <br>\nHopefully, they are back sooner than later!</p>",
      "rawMarkdown": "It seems they will be back soon. This [commit](https://github.com/Kaggle/docker-python/pull/1216/commits/9fc103b7328adfc694f72f25477b16e5499f3bd2) added cudf and cuml back. If you check the latest docker image, cudf and cuml are also there https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97 \nHopefully, they are back sooner than later!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2149771,
      "author_name": "cdeotte",
      "author_url": "",
      "post_date": "02/18/2023 16:52:24",
      "content": "<p>Hmm… this is weird, I have also just confirmed if we start a new GPU Kaggle notebook (inside or outside this specific competition) we cannot access RAPIDS cuDF nor cuML. For the time being, we need to fork an older notebook that uses GPU and keep it \"Pinned to original environment\". Then the GPU Kaggle notebook will use an older docker image and we can use RAPIDS. </p>\n<p>Phil ( <a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a> ), can you look into this? Thank you</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2149939,
      "author_name": "jiweiliu",
      "author_url": "",
      "post_date": "02/18/2023 19:50:41",
      "content": "<p>It seems they will be back soon. This <a href=\"https://github.com/Kaggle/docker-python/pull/1216/commits/9fc103b7328adfc694f72f25477b16e5499f3bd2\" target=\"_blank\">commit</a> added cudf and cuml back. If you check the latest docker image, cudf and cuml are also there <a href=\"https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97\" target=\"_blank\">https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97</a> <br>\nHopefully, they are back sooner than later!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2149745": "I think there's no installation of cudf or cuml in the latest docker container. I can't use cudf/cuml with any GPU notebook (P100 and 2xT4). cupy is installed though. Has anyone faced the same problem recently?\n\nBelow is the screenshot of the same:![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4359632%2Fc71239397074646ec90a1a99eae60779%2FScreenshot%202023-02-18%20at%209.54.24%20PM.png?generation=1676737534860229&alt=media)",
    "2149771": "Hmm... this is weird, I have also just confirmed if we start a new GPU Kaggle notebook (inside or outside this specific competition) we cannot access RAPIDS cuDF nor cuML. For the time being, we need to fork an older notebook that uses GPU and keep it \"Pinned to original environment\". Then the GPU Kaggle notebook will use an older docker image and we can use RAPIDS. \n\nPhil ( @philculliton ), can you look into this? Thank you",
    "2149939": "It seems they will be back soon. This [commit](https://github.com/Kaggle/docker-python/pull/1216/commits/9fc103b7328adfc694f72f25477b16e5499f3bd2) added cudf and cuml back. If you check the latest docker image, cudf and cuml are also there https://github.com/Kaggle/docker-python/blob/main/Dockerfile.tmpl#L97 \nHopefully, they are back sooner than later!"
  },
  "source": "meta"
}