{
  "id": 123388,
  "title": "Kaggle Kernel CPU shooting up while loading parquet ?",
  "url": "/competitions/bengaliai-cv19/discussion/123388",
  "author_name": "",
  "post_date": "2019-12-27T09:19:42.330597Z",
  "votes": 2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I was able to load and resize parquet file for training data in somewhat around 1 minute . But suddenly something happened and now it takes huge time loading one train dataset and CPU shoots up to 195% while using pd.read_parquet . Anyone faced similar issue ? </p>\n\n<p>This is completely in kaggle kernel .</p>\n\n<p>code is simple : \n<code>\ndata = pd.read_parquet(PATH+f'train_image_data_0.parquet')\ndata =Resize(data)\n</code></p>\n\n<p>Same code was working couple of hours ago .</p>",
  "messages": [
    {
      "id": "704290",
      "postDate": "12/27/2019 09:19:42",
      "content": "<p>I was able to load and resize parquet file for training data in somewhat around 1 minute . But suddenly something happened and now it takes huge time loading one train dataset and CPU shoots up to 195% while using pd.read_parquet . Anyone faced similar issue ? </p>\n\n<p>This is completely in kaggle kernel .</p>\n\n<p>code is simple : \n<code>\ndata = pd.read_parquet(PATH+f'train_image_data_0.parquet')\ndata =Resize(data)\n</code></p>\n\n<p>Same code was working couple of hours ago .</p>",
      "rawMarkdown": "I was able to load and resize parquet file for training data in somewhat around 1 minute . But suddenly something happened and now it takes huge time loading one train dataset and CPU shoots up to 195% while using pd.read_parquet . Anyone faced similar issue ? \n\nThis is completely in kaggle kernel .\n\ncode is simple : \n```\ndata = pd.read_parquet(PATH+f'train_image_data_0.parquet')\ndata =Resize(data)\n```\n\nSame code was working couple of hours ago .",
      "votes": null
    },
    {
      "id": "704402",
      "postDate": "12/27/2019 12:46:05",
      "content": "<p><a href=\"/phoenix9032\">@phoenix9032</a> <code>paraquest</code> is taking lot of space for me too, around 13-14 Gb, when all the 4 <code>paraquest</code> open at same time.  But, for all the four files, it always took longer than 1 min. </p>",
      "rawMarkdown": "phoenix9032 ```paraquest``` is taking lot of space for me too, around 13-14 Gb, when all the 4 ```paraquest``` open at same time.  But, for all the four files, it always took longer than 1 min.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 704402,
      "author_name": "chandraroy",
      "author_url": "",
      "post_date": "12/27/2019 12:46:05",
      "content": "<p><a href=\"/phoenix9032\">@phoenix9032</a> <code>paraquest</code> is taking lot of space for me too, around 13-14 Gb, when all the 4 <code>paraquest</code> open at same time.  But, for all the four files, it always took longer than 1 min. </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "704290": "I was able to load and resize parquet file for training data in somewhat around 1 minute . But suddenly something happened and now it takes huge time loading one train dataset and CPU shoots up to 195% while using pd.read_parquet . Anyone faced similar issue ? \n\nThis is completely in kaggle kernel .\n\ncode is simple : \n```\ndata = pd.read_parquet(PATH+f'train_image_data_0.parquet')\ndata =Resize(data)\n```\n\nSame code was working couple of hours ago .",
    "704402": "phoenix9032 ```paraquest``` is taking lot of space for me too, around 13-14 Gb, when all the 4 ```paraquest``` open at same time.  But, for all the four files, it always took longer than 1 min."
  },
  "source": "meta"
}