{
  "id": 335209,
  "title": "How to use different notebooks for same dataset?",
  "url": "/competitions/amex-default-prediction/discussion/335209",
  "author_name": "",
  "post_date": "2022-07-05T06:24:31.403124Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi all !</p>\n<p>While  running my code in kaggle, i am getting error like \"your notebook tried to allocate more memory than is available. it has restarted.\" </p>\n<p>So can i use two different notebooks to run this code ? lets assume i ended at a PCA dataframe and i want to impliment ML model in next notebook without uploading datasets in the new notebook, is that possible?</p>",
  "messages": [
    {
      "id": "1843809",
      "postDate": "07/05/2022 06:24:31",
      "content": "<p>Hi all !</p>\n<p>While  running my code in kaggle, i am getting error like \"your notebook tried to allocate more memory than is available. it has restarted.\" </p>\n<p>So can i use two different notebooks to run this code ? lets assume i ended at a PCA dataframe and i want to impliment ML model in next notebook without uploading datasets in the new notebook, is that possible?</p>",
      "rawMarkdown": "Hi all !\n\nWhile  running my code in kaggle, i am getting error like \"your notebook tried to allocate more memory than is available. it has restarted.\" \n\nSo can i use two different notebooks to run this code ? lets assume i ended at a PCA dataframe and i want to impliment ML model in next notebook without uploading datasets in the new notebook, is that possible?",
      "votes": null
    },
    {
      "id": "1843953",
      "postDate": "07/05/2022 08:20:27",
      "content": "<p>I usually save my files and upload them to a different/same notebook and continue my working. But that should be done only if its not possible for you to clean the RAM by using commands like e.g. <code>del</code> or <code>gc.collect()</code> etc.</p>",
      "rawMarkdown": "I usually save my files and upload them to a different/same notebook and continue my working. But that should be done only if its not possible for you to clean the RAM by using commands like e.g. `del` or `gc.collect()` etc.",
      "votes": null
    },
    {
      "id": "1843983",
      "postDate": "07/05/2022 08:51:46",
      "content": "<p>Kaggle notebooks is a very good environment to learn memory management skills :)</p>",
      "rawMarkdown": "Kaggle notebooks is a very good environment to learn memory management skills :)",
      "votes": null
    },
    {
      "id": "1844219",
      "postDate": "07/05/2022 12:23:06",
      "content": "<p>You will have to load your dataframe in chunks (parts) and use partial fiting like <a href=\"https://stackoverflow.com/questions/32191219/python-pca-on-matrix-too-large-to-fit-into-memory\" target=\"_blank\">explaied here</a></p>",
      "rawMarkdown": "You will have to load your dataframe in chunks (parts) and use partial fiting like [explaied here](https://stackoverflow.com/questions/32191219/python-pca-on-matrix-too-large-to-fit-into-memory)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1843953,
      "author_name": "aliabdin1",
      "author_url": "",
      "post_date": "07/05/2022 08:20:27",
      "content": "<p>I usually save my files and upload them to a different/same notebook and continue my working. But that should be done only if its not possible for you to clean the RAM by using commands like e.g. <code>del</code> or <code>gc.collect()</code> etc.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1843983,
      "author_name": "raddar",
      "author_url": "",
      "post_date": "07/05/2022 08:51:46",
      "content": "<p>Kaggle notebooks is a very good environment to learn memory management skills :)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1844219,
      "author_name": "waldemar",
      "author_url": "",
      "post_date": "07/05/2022 12:23:06",
      "content": "<p>You will have to load your dataframe in chunks (parts) and use partial fiting like <a href=\"https://stackoverflow.com/questions/32191219/python-pca-on-matrix-too-large-to-fit-into-memory\" target=\"_blank\">explaied here</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1843809": "Hi all !\n\nWhile  running my code in kaggle, i am getting error like \"your notebook tried to allocate more memory than is available. it has restarted.\" \n\nSo can i use two different notebooks to run this code ? lets assume i ended at a PCA dataframe and i want to impliment ML model in next notebook without uploading datasets in the new notebook, is that possible?",
    "1843953": "I usually save my files and upload them to a different/same notebook and continue my working. But that should be done only if its not possible for you to clean the RAM by using commands like e.g. `del` or `gc.collect()` etc.",
    "1843983": "Kaggle notebooks is a very good environment to learn memory management skills :)",
    "1844219": "You will have to load your dataframe in chunks (parts) and use partial fiting like [explaied here](https://stackoverflow.com/questions/32191219/python-pca-on-matrix-too-large-to-fit-into-memory)"
  },
  "source": "meta"
}