{
  "id": 273681,
  "title": "Basics-Level Discussions for new-to-kaggle people",
  "url": "/competitions/wikipedia-image-caption/discussion/273681",
  "author_name": "",
  "post_date": "2021-09-22T05:13:53.616742500Z",
  "votes": 3,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hello folks, I am fairly new to large-dataset-competitions on Kaggle. I would really appreciate if someone could point out a few resources that you guys used while first handling such large datasets. Thank you :)</p>\n<p>I am also opening this thread for relatively new people on Kaggle to share their \"fears\", so that the experts here can guide and possibly by the end of the competition we see a few more confident people in the field.</p>",
  "messages": [
    {
      "id": "1520020",
      "postDate": "09/22/2021 05:13:53",
      "content": "<p>Hello folks, I am fairly new to large-dataset-competitions on Kaggle. I would really appreciate if someone could point out a few resources that you guys used while first handling such large datasets. Thank you :)</p>\n<p>I am also opening this thread for relatively new people on Kaggle to share their \"fears\", so that the experts here can guide and possibly by the end of the competition we see a few more confident people in the field.</p>",
      "rawMarkdown": "Hello folks, I am fairly new to large-dataset-competitions on Kaggle. I would really appreciate if someone could point out a few resources that you guys used while first handling such large datasets. Thank you :)\n\nI am also opening this thread for relatively new people on Kaggle to share their \"fears\", so that the experts here can guide and possibly by the end of the competition we see a few more confident people in the field.",
      "votes": null
    },
    {
      "id": "1520722",
      "postDate": "09/22/2021 14:21:44",
      "content": "<p>I'm also new, but was blown away how much difference is made by just the changing library you are using.  <br>\nOr the format of files:<br>\n<a href=\"https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/\" target=\"_blank\">https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/</a><br>\n<a href=\"https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro\" target=\"_blank\">https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro</a></p>\n<p>I love pandas, but since then I never use it for reading data from a file. Also, changing types of data you have in a data frame becomes super important when there are several millions of records.</p>",
      "rawMarkdown": "I'm also new, but was blown away how much difference is made by just the changing library you are using.  \nOr the format of files:\n[https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/](https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/)\n[https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro](https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro)\n\nI love pandas, but since then I never use it for reading data from a file. Also, changing types of data you have in a data frame becomes super important when there are several millions of records.",
      "votes": null
    },
    {
      "id": "1521166",
      "postDate": "09/23/2021 01:28:38",
      "content": "<p>Thank you for the references.</p>",
      "rawMarkdown": "Thank you for the references.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1520722,
      "author_name": "marekgp",
      "author_url": "",
      "post_date": "09/22/2021 14:21:44",
      "content": "<p>I'm also new, but was blown away how much difference is made by just the changing library you are using.  <br>\nOr the format of files:<br>\n<a href=\"https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/\" target=\"_blank\">https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/</a><br>\n<a href=\"https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro\" target=\"_blank\">https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro</a></p>\n<p>I love pandas, but since then I never use it for reading data from a file. Also, changing types of data you have in a data frame becomes super important when there are several millions of records.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1521166,
          "author_name": "swaroopnath6",
          "author_url": "",
          "post_date": "09/23/2021 01:28:38",
          "content": "<p>Thank you for the references.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1520020": "Hello folks, I am fairly new to large-dataset-competitions on Kaggle. I would really appreciate if someone could point out a few resources that you guys used while first handling such large datasets. Thank you :)\n\nI am also opening this thread for relatively new people on Kaggle to share their \"fears\", so that the experts here can guide and possibly by the end of the competition we see a few more confident people in the field.",
    "1520722": "I'm also new, but was blown away how much difference is made by just the changing library you are using.  \nOr the format of files:\n[https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/](https://www.kaggle.com/rohanrao/tutorial-on-reading-large-datasets/)\n[https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro](https://www.kaggle.com/bextuychiev/how-to-work-w-million-row-datasets-like-a-pro)\n\nI love pandas, but since then I never use it for reading data from a file. Also, changing types of data you have in a data frame becomes super important when there are several millions of records.",
    "1521166": "Thank you for the references."
  },
  "source": "meta"
}