{
  "id": 189876,
  "title": "Problem loading up the data ",
  "url": "/competitions/riiid-test-answer-prediction/discussion/189876",
  "author_name": "",
  "post_date": "2020-10-09T06:33:44.600160300Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Guys , I seem to face a problem of memory when I try to load read the csv. I then tried to copied for public notebooks and understood that we have to use the script and make environment. However still it takes a lot of time of run the pd.read_csv then also ? Anyone facing the same problem ??</p>",
  "messages": [
    {
      "id": "1043674",
      "postDate": "10/09/2020 06:33:44",
      "content": "<p>Guys , I seem to face a problem of memory when I try to load read the csv. I then tried to copied for public notebooks and understood that we have to use the script and make environment. However still it takes a lot of time of run the pd.read_csv then also ? Anyone facing the same problem ??</p>",
      "rawMarkdown": "Guys , I seem to face a problem of memory when I try to load read the csv. I then tried to copied for public notebooks and understood that we have to use the script and make environment. However still it takes a lot of time of run the pd.read_csv then also ? Anyone facing the same problem ??",
      "votes": null
    },
    {
      "id": "1043677",
      "postDate": "10/09/2020 06:37:19",
      "content": "<p>This question was <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908\" target=\"_blank\">already answered</a> several times, along with a <a href=\"https://www.kaggle.com/sirishks/cant-load-train-data\" target=\"_blank\">kernel</a> to demonstrate this.</p>\n<p>There are also other options such as \"Dask\" - read the forum posts for details.</p>",
      "rawMarkdown": "This question was [already answered](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908) several times, along with a [kernel](https://www.kaggle.com/sirishks/cant-load-train-data) to demonstrate this.\n\nThere are also other options such as \"Dask\" - read the forum posts for details.",
      "votes": null
    },
    {
      "id": "1043685",
      "postDate": "10/09/2020 06:48:52",
      "content": "<p>Okay , one more thing do I need to use this method for every csv file</p>",
      "rawMarkdown": "Okay , one more thing do I need to use this method for every csv file",
      "votes": null
    },
    {
      "id": "1044453",
      "postDate": "10/09/2020 19:24:18",
      "content": "<p>Try Vaex. It may be slow to access, but features are made almost instantly and lightgbm and other ml models are built in.</p>",
      "rawMarkdown": "Try Vaex. It may be slow to access, but features are made almost instantly and lightgbm and other ml models are built in.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1043677,
      "author_name": "sirishks",
      "author_url": "",
      "post_date": "10/09/2020 06:37:19",
      "content": "<p>This question was <a href=\"https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908\" target=\"_blank\">already answered</a> several times, along with a <a href=\"https://www.kaggle.com/sirishks/cant-load-train-data\" target=\"_blank\">kernel</a> to demonstrate this.</p>\n<p>There are also other options such as \"Dask\" - read the forum posts for details.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1043685,
          "author_name": "sahilmaheshwari",
          "author_url": "",
          "post_date": "10/09/2020 06:48:52",
          "content": "<p>Okay , one more thing do I need to use this method for every csv file</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1044453,
      "author_name": "eladwar",
      "author_url": "",
      "post_date": "10/09/2020 19:24:18",
      "content": "<p>Try Vaex. It may be slow to access, but features are made almost instantly and lightgbm and other ml models are built in.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1043674": "Guys , I seem to face a problem of memory when I try to load read the csv. I then tried to copied for public notebooks and understood that we have to use the script and make environment. However still it takes a lot of time of run the pd.read_csv then also ? Anyone facing the same problem ??",
    "1043677": "This question was [already answered](https://www.kaggle.com/c/riiid-test-answer-prediction/discussion/188908) several times, along with a [kernel](https://www.kaggle.com/sirishks/cant-load-train-data) to demonstrate this.\n\nThere are also other options such as \"Dask\" - read the forum posts for details.",
    "1043685": "Okay , one more thing do I need to use this method for every csv file",
    "1044453": "Try Vaex. It may be slow to access, but features are made almost instantly and lightgbm and other ml models are built in."
  },
  "source": "meta"
}