{
  "id": 506349,
  "title": "Not able to read Parquet file",
  "url": "/competitions/leash-BELKA/discussion/506349",
  "author_name": "",
  "post_date": "2024-05-21T15:08:51.271397100Z",
  "votes": 1,
  "comment_count": 1,
  "views": 0,
  "content": "<p>My RAM size is 12 GB but im not able to read the parquet file using pandas, is there a way to split the file into halves or any other way to compress and read?</p>",
  "messages": [
    {
      "id": "2827589",
      "postDate": "05/21/2024 15:08:51",
      "content": "<p>My RAM size is 12 GB but im not able to read the parquet file using pandas, is there a way to split the file into halves or any other way to compress and read?</p>",
      "rawMarkdown": "My RAM size is 12 GB but im not able to read the parquet file using pandas, is there a way to split the file into halves or any other way to compress and read?",
      "votes": null
    },
    {
      "id": "2827620",
      "postDate": "05/21/2024 15:22:37",
      "content": "<p>import polars<br>\ndata = pl.read_parquet(data_path, n_rows=10000)</p>\n<p>With polars you can read only the specified rows from the top.<br>\nIf you want to return to pandas: polars.to_pandas(data)</p>",
      "rawMarkdown": "import polars\ndata = pl.read_parquet(data_path, n_rows=10000)\n\nWith polars you can read only the specified rows from the top.\nIf you want to return to pandas: polars.to_pandas(data)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2827620,
      "author_name": "masasato1999",
      "author_url": "",
      "post_date": "05/21/2024 15:22:37",
      "content": "<p>import polars<br>\ndata = pl.read_parquet(data_path, n_rows=10000)</p>\n<p>With polars you can read only the specified rows from the top.<br>\nIf you want to return to pandas: polars.to_pandas(data)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2827589": "My RAM size is 12 GB but im not able to read the parquet file using pandas, is there a way to split the file into halves or any other way to compress and read?",
    "2827620": "import polars\ndata = pl.read_parquet(data_path, n_rows=10000)\n\nWith polars you can read only the specified rows from the top.\nIf you want to return to pandas: polars.to_pandas(data)"
  },
  "source": "meta"
}