{
  "id": 2205,
  "title": "loading training dataset in R",
  "url": "/competitions/Raising-Money-to-Fund-an-Organizational-Mission/discussion/2205",
  "author_name": "",
  "post_date": "2012-07-20T04:45:48.007Z",
  "votes": null,
  "comment_count": 2,
  "views": 1691,
  "content": "<p>Did someone managed to open the file <em>&quot;kaggle_training_dataset_formatted2.txt</em>&quot; in R?</p>\r\n<p>My computer has &quot;only&quot; 12GB of RAM and it is not able to load the file. It results in errors and complains that there is not sufficient memory...</p>",
  "messages": [
    {
      "id": "12478",
      "postDate": "07/20/2012 04:45:48",
      "content": "<p>Did someone managed to open the file <em>&quot;kaggle_training_dataset_formatted2.txt</em>&quot; in R?</p>\r\n<p>My computer has &quot;only&quot; 12GB of RAM and it is not able to load the file. It results in errors and complains that there is not sufficient memory...</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "12559",
      "postDate": "07/21/2012 15:45:26",
      "content": "<p>I'm going to try dumping it into MySQL and using this: http://cran.r-project.org/web/packages/RMySQL/RMySQL.pdf</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "12659",
      "postDate": "07/23/2012 00:10:40",
      "content": "<p>Yes this is what I figured as well, it is almost impossible to load this huge database in RAM, yet to perform any meaningful model on the 75 million lines of data.</p>\r\n<p>We will need to be creative! :)</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 12559,
      "author_name": "zacstewart",
      "author_url": "",
      "post_date": "07/21/2012 15:45:26",
      "content": "<p>I'm going to try dumping it into MySQL and using this: http://cran.r-project.org/web/packages/RMySQL/RMySQL.pdf</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 12659,
      "author_name": "benoitplante",
      "author_url": "",
      "post_date": "07/23/2012 00:10:40",
      "content": "<p>Yes this is what I figured as well, it is almost impossible to load this huge database in RAM, yet to perform any meaningful model on the 75 million lines of data.</p>\r\n<p>We will need to be creative! :)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "12478": "",
    "12559": "",
    "12659": ""
  },
  "source": "meta"
}