{
  "id": 275237,
  "title": "Reading tsv file gives error in Kaggle ",
  "url": "/competitions/wikipedia-image-caption/discussion/275237",
  "author_name": "",
  "post_date": "2021-09-29T13:48:39.352852300Z",
  "votes": 1,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I tried to read tsv file through Pandas but Kaggle ran out of memory <br>\nHow to resolve this?</p>",
  "messages": [
    {
      "id": "1528239",
      "postDate": "09/29/2021 13:48:39",
      "content": "<p>I tried to read tsv file through Pandas but Kaggle ran out of memory <br>\nHow to resolve this?</p>",
      "rawMarkdown": "I tried to read tsv file through Pandas but Kaggle ran out of memory \nHow to resolve this?",
      "votes": null
    },
    {
      "id": "1529791",
      "postDate": "09/30/2021 16:50:23",
      "content": "<p>One way could be to read the files in smaller chunks by limiting the number of rows in read_csv. <br>\nAlso we can use <a href=\"https://www.kaggle.com/msafi04\" target=\"_blank\">@msafi04</a> 's <a href=\"https://www.kaggle.com/msafi04/train-tsv-file-to-feather-files\" target=\"_blank\">feather format data</a> which is compact enough to fit the RAM (but note entries with NA are dropped). </p>",
      "rawMarkdown": "One way could be to read the files in smaller chunks by limiting the number of rows in read_csv. \nAlso we can use @msafi04 's [feather format data](https://www.kaggle.com/msafi04/train-tsv-file-to-feather-files) which is compact enough to fit the RAM (but note entries with NA are dropped).",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1529791,
      "author_name": "b0ww1d",
      "author_url": "",
      "post_date": "09/30/2021 16:50:23",
      "content": "<p>One way could be to read the files in smaller chunks by limiting the number of rows in read_csv. <br>\nAlso we can use <a href=\"https://www.kaggle.com/msafi04\" target=\"_blank\">@msafi04</a> 's <a href=\"https://www.kaggle.com/msafi04/train-tsv-file-to-feather-files\" target=\"_blank\">feather format data</a> which is compact enough to fit the RAM (but note entries with NA are dropped). </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1528239": "I tried to read tsv file through Pandas but Kaggle ran out of memory \nHow to resolve this?",
    "1529791": "One way could be to read the files in smaller chunks by limiting the number of rows in read_csv. \nAlso we can use @msafi04 's [feather format data](https://www.kaggle.com/msafi04/train-tsv-file-to-feather-files) which is compact enough to fit the RAM (but note entries with NA are dropped)."
  },
  "source": "meta"
}