{
  "id": 190538,
  "title": "Is there a way to upload the entire train database?",
  "url": "/competitions/riiid-test-answer-prediction/discussion/190538",
  "author_name": "",
  "post_date": "2020-10-12T08:33:28.840003400Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Is there a way to upload the entire train database without causing notebook crash? I'm using pandas.read_csv right now, but when I try to import the entire database it crashs, for this reason I'm using around half of the data avaiable in order to prevent crashing right now</p>",
  "messages": [
    {
      "id": "1047073",
      "postDate": "10/12/2020 08:33:28",
      "content": "<p>Is there a way to upload the entire train database without causing notebook crash? I'm using pandas.read_csv right now, but when I try to import the entire database it crashs, for this reason I'm using around half of the data avaiable in order to prevent crashing right now</p>",
      "rawMarkdown": "Is there a way to upload the entire train database without causing notebook crash? I'm using pandas.read_csv right now, but when I try to import the entire database it crashs, for this reason I'm using around half of the data avaiable in order to prevent crashing right now",
      "votes": null
    },
    {
      "id": "1047134",
      "postDate": "10/12/2020 09:44:51",
      "content": "<p><a href=\"https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets\" target=\"_blank\">Here</a> are some options though I found <a href=\"https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid\" target=\"_blank\">this</a> the fastest.</p>",
      "rawMarkdown": "[Here](https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets) are some options though I found [this](https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid) the fastest.",
      "votes": null
    },
    {
      "id": "1047140",
      "postDate": "10/12/2020 09:52:29",
      "content": "<p>exactly what I was looking for, thank you :)</p>",
      "rawMarkdown": "exactly what I was looking for, thank you :)",
      "votes": null
    },
    {
      "id": "1047295",
      "postDate": "10/12/2020 12:56:53",
      "content": "<p>Try using Dask, it can read (very) large dataset.</p>",
      "rawMarkdown": "Try using Dask, it can read (very) large dataset.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1047134,
      "author_name": "rohanrao",
      "author_url": "",
      "post_date": "10/12/2020 09:44:51",
      "content": "<p><a href=\"https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets\" target=\"_blank\">Here</a> are some options though I found <a href=\"https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid\" target=\"_blank\">this</a> the fastest.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1047140,
          "author_name": "domizianostingi",
          "author_url": "",
          "post_date": "10/12/2020 09:52:29",
          "content": "<p>exactly what I was looking for, thank you :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1047295,
      "author_name": "aeryss",
      "author_url": "",
      "post_date": "10/12/2020 12:56:53",
      "content": "<p>Try using Dask, it can read (very) large dataset.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1047073": "Is there a way to upload the entire train database without causing notebook crash? I'm using pandas.read_csv right now, but when I try to import the entire database it crashs, for this reason I'm using around half of the data avaiable in order to prevent crashing right now",
    "1047134": "[Here](https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets) are some options though I found [this](https://www.kaggle.com/rohanrao/riiid-with-blazing-fast-rid) the fastest.",
    "1047140": "exactly what I was looking for, thank you :)",
    "1047295": "Try using Dask, it can read (very) large dataset."
  },
  "source": "meta"
}