{
  "id": 189722,
  "title": "Loading whole training data in dataframe ( with notebook )",
  "url": "/competitions/riiid-test-answer-prediction/discussion/189722",
  "author_name": "",
  "post_date": "2020-10-08T13:09:52.241894100Z",
  "votes": 4,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Here is notebook to read whole training data ( yep you read right all rows of train.csv file 😊 )</p>\n<p>I did test and API was able to iterate 1 million record in 90 seconds.<br>\nGroup by on dataframe on one column took 3 minutes.</p>\n<p>Notebook link<br>\n<a href=\"https://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api\" target=\"_blank\">https://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api</a></p>",
  "messages": [
    {
      "id": "1042778",
      "postDate": "10/08/2020 13:09:52",
      "content": "<p>Here is notebook to read whole training data ( yep you read right all rows of train.csv file 😊 )</p>\n<p>I did test and API was able to iterate 1 million record in 90 seconds.<br>\nGroup by on dataframe on one column took 3 minutes.</p>\n<p>Notebook link<br>\n<a href=\"https://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api\" target=\"_blank\">https://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api</a></p>",
      "rawMarkdown": "Here is notebook to read whole training data ( yep you read right all rows of train.csv file 😊 )\n\nI did test and API was able to iterate 1 million record in 90 seconds.\nGroup by on dataframe on one column took 3 minutes.\n\nNotebook link\nhttps://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api",
      "votes": null
    },
    {
      "id": "1043444",
      "postDate": "10/09/2020 01:53:02",
      "content": "<p>Everything that helps to read that massive amount of data is Welcome. Like yours DASK relevant Kaggle Notebook.</p>",
      "rawMarkdown": "Everything that helps to read that massive amount of data is Welcome. Like yours DASK relevant Kaggle Notebook.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1043444,
      "author_name": "mpwolke",
      "author_url": "",
      "post_date": "10/09/2020 01:53:02",
      "content": "<p>Everything that helps to read that massive amount of data is Welcome. Like yours DASK relevant Kaggle Notebook.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1042778": "Here is notebook to read whole training data ( yep you read right all rows of train.csv file 😊 )\n\nI did test and API was able to iterate 1 million record in 90 seconds.\nGroup by on dataframe on one column took 3 minutes.\n\nNotebook link\nhttps://www.kaggle.com/rajnishe/riiid-read-full-file-dask-api",
    "1043444": "Everything that helps to read that massive amount of data is Welcome. Like yours DASK relevant Kaggle Notebook."
  },
  "source": "meta"
}