{
  "id": 190154,
  "title": "Running Out Of Memory When Loading train.csv",
  "url": "/competitions/riiid-test-answer-prediction/discussion/190154",
  "author_name": "",
  "post_date": "2020-10-10T12:15:53.264194200Z",
  "votes": 2,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Anyone else facing the same problem? My local system as well as Kaggle notebook is not able to load the train.csv file. It's showing a prompt to upgrade to Google AI Notebook.</p>",
  "messages": [
    {
      "id": "1045179",
      "postDate": "10/10/2020 12:15:53",
      "content": "<p>Anyone else facing the same problem? My local system as well as Kaggle notebook is not able to load the train.csv file. It's showing a prompt to upgrade to Google AI Notebook.</p>",
      "rawMarkdown": "Anyone else facing the same problem? My local system as well as Kaggle notebook is not able to load the train.csv file. It's showing a prompt to upgrade to Google AI Notebook.",
      "votes": null
    },
    {
      "id": "1045251",
      "postDate": "10/10/2020 13:05:33",
      "content": "<p>You can use datatable: <a href=\"https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid\" target=\"_blank\">https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid</a></p>",
      "rawMarkdown": "You can use datatable: https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid",
      "votes": null
    },
    {
      "id": "1045319",
      "postDate": "10/10/2020 14:10:01",
      "content": "<p>You can use <a href=\"https://www.kaggle.com/markwijkhuizen/riiid-answer-correctness-prediction-files\" target=\"_blank\">this</a> public dataset.<br>\nAll columns are downcasted to reduce memory usage and loading time.</p>",
      "rawMarkdown": "You can use [this](https://www.kaggle.com/markwijkhuizen/riiid-answer-correctness-prediction-files) public dataset.\nAll columns are downcasted to reduce memory usage and loading time.",
      "votes": null
    },
    {
      "id": "1045525",
      "postDate": "10/10/2020 18:08:19",
      "content": "<p>use feather parquet formats or dask</p>",
      "rawMarkdown": "use feather parquet formats or dask",
      "votes": null
    },
    {
      "id": "1045985",
      "postDate": "10/11/2020 08:06:42",
      "content": "<p>Try to use Dask, cuDF, and other such library or try to convert the data into parquet files and read the data </p>",
      "rawMarkdown": "Try to use Dask, cuDF, and other such library or try to convert the data into parquet files and read the data",
      "votes": null
    },
    {
      "id": "1046508",
      "postDate": "10/11/2020 18:10:59",
      "content": "<p>This question was <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908\" target=\"_blank\">already answered</a> several times, along with a <a href=\"https://www.kaggle.com/sirishks/cant-load-train-data\" target=\"_blank\">kernel</a> to demonstrate the solution.</p>\n<p>As mentioned by <a href=\"https://www.kaggle.com/vpkprasanna\" target=\"_blank\">@vpkprasanna</a>, there are also other options such as Dask, cuDF - read the forum posts for details.</p>",
      "rawMarkdown": "This question was [already answered](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908) several times, along with a [kernel](https://www.kaggle.com/sirishks/cant-load-train-data) to demonstrate the solution.\n\nAs mentioned by @vpkprasanna, there are also other options such as Dask, cuDF - read the forum posts for details.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1045251,
      "author_name": "rohanrao",
      "author_url": "",
      "post_date": "10/10/2020 13:05:33",
      "content": "<p>You can use datatable: <a href=\"https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid\" target=\"_blank\">https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1045319,
      "author_name": "markwijkhuizen",
      "author_url": "",
      "post_date": "10/10/2020 14:10:01",
      "content": "<p>You can use <a href=\"https://www.kaggle.com/markwijkhuizen/riiid-answer-correctness-prediction-files\" target=\"_blank\">this</a> public dataset.<br>\nAll columns are downcasted to reduce memory usage and loading time.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1045525,
      "author_name": "elvinagammed",
      "author_url": "",
      "post_date": "10/10/2020 18:08:19",
      "content": "<p>use feather parquet formats or dask</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1045985,
      "author_name": "vpkprasanna",
      "author_url": "",
      "post_date": "10/11/2020 08:06:42",
      "content": "<p>Try to use Dask, cuDF, and other such library or try to convert the data into parquet files and read the data </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1046508,
      "author_name": "sirishks",
      "author_url": "",
      "post_date": "10/11/2020 18:10:59",
      "content": "<p>This question was <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908\" target=\"_blank\">already answered</a> several times, along with a <a href=\"https://www.kaggle.com/sirishks/cant-load-train-data\" target=\"_blank\">kernel</a> to demonstrate the solution.</p>\n<p>As mentioned by <a href=\"https://www.kaggle.com/vpkprasanna\" target=\"_blank\">@vpkprasanna</a>, there are also other options such as Dask, cuDF - read the forum posts for details.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1045179": "Anyone else facing the same problem? My local system as well as Kaggle notebook is not able to load the train.csv file. It's showing a prompt to upgrade to Google AI Notebook.",
    "1045251": "You can use datatable: https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid",
    "1045319": "You can use [this](https://www.kaggle.com/markwijkhuizen/riiid-answer-correctness-prediction-files) public dataset.\nAll columns are downcasted to reduce memory usage and loading time.",
    "1045525": "use feather parquet formats or dask",
    "1045985": "Try to use Dask, cuDF, and other such library or try to convert the data into parquet files and read the data",
    "1046508": "This question was [already answered](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908) several times, along with a [kernel](https://www.kaggle.com/sirishks/cant-load-train-data) to demonstrate the solution.\n\nAs mentioned by @vpkprasanna, there are also other options such as Dask, cuDF - read the forum posts for details."
  },
  "source": "meta"
}