{ "id": 244358, "title": "deep neural network getting timed out", "url": "/competitions/siim-covid19-detection/discussion/244358", "author_name": "", "post_date": "2021-06-06T12:35:09.738994600Z", "votes": 1, "comment_count": 6, "views": 0, "content": "

My deep neural network models such as effnetb7 are getting timed out in google colab with 25 gb of ram what can we do resolve the issue.How much ram does kaggle use in the final submission.Is it 16 gb

", "messages": [ { "id": "1338407", "postDate": "06/06/2021 12:35:09", "content": "

My deep neural network models such as effnetb7 are getting timed out in google colab with 25 gb of ram what can we do resolve the issue.How much ram does kaggle use in the final submission.Is it 16 gb

", "rawMarkdown": "My deep neural network models such as effnetb7 are getting timed out in google colab with 25 gb of ram what can we do resolve the issue.How much ram does kaggle use in the final submission.Is it 16 gb", "votes": null }, { "id": "1338431", "postDate": "06/06/2021 13:00:47", "content": "

Out of ram error i

", "rawMarkdown": "Out of ram error i", "votes": null }, { "id": "1339000", "postDate": "06/06/2021 23:55:50", "content": "

Hi @jimmycool

\n

Are you using GPU or TPU?
\nWhat is the size of your input images?

", "rawMarkdown": "Hi @jimmycool \n\nAre you using GPU or TPU? \nWhat is the size of your input images?", "votes": null }, { "id": "1339053", "postDate": "06/07/2021 02:08:08", "content": "

I am using Google colab pro with 25 gb ram and the image size is 256,256,3 in RGB format even using just 2000 images from the train dataset it is getting out of memory error

", "rawMarkdown": "I am using Google colab pro with 25 gb ram and the image size is 256,256,3 in RGB format even using just 2000 images from the train dataset it is getting out of memory error", "votes": null }, { "id": "1339601", "postDate": "06/07/2021 10:55:58", "content": "

Did you try to decrease your batch size to fit into the memory? You can also try to make it work with smaller model instead of B7.

", "rawMarkdown": "Did you try to decrease your batch size to fit into the memory? You can also try to make it work with smaller model instead of B7.", "votes": null }, { "id": "1339665", "postDate": "06/07/2021 11:37:52", "content": "

inside your code Keep Clearing the Memory Using the del Statement
\nAlong with the gc. collect() method,

\n

https://www.delftstack.com/howto/python/python-clear-memory/

", "rawMarkdown": "inside your code Keep Clearing the Memory Using the `del ` Statement\nAlong with the ` gc. collect()` method, \n\nhttps://www.delftstack.com/howto/python/python-clear-memory/", "votes": null }, { "id": "1340369", "postDate": "06/07/2021 20:17:41", "content": "

The memory is not enough you can buy memory or u can got free 😊 if u need just 25 GB

\n

1- U can check this😊

\n

i = []
\nwhile True:
\n i.append(i)

\n

\n

2- Wait for few minutes, after that you will get a prompt that your notebook got crashed, do you want to increase ram ?

\n

3- In the prompt click - yes

\n

\n

4- As you see the ram increase from 12GB to 25GB.

\n

\n

This is Google_Colab.pdf πŸ‘‡

\n

https://github.com/yasserhessein/What-is-Google-Colab-and-how-can-I-use-it/blob/main/Google_Colab.pdf

", "rawMarkdown": "The memory is not enough you can buy memory or u can got free 😊 if u need just 25 GB \n\n\n 1- U can check this😊 \n\ni = []\nwhile True:\n i.append(i)\n\n\n\n2- Wait for few minutes, after that you will get a prompt that your notebook got crashed, do you want to increase ram ?\n\n\n\n3- In the prompt click - yes\n\n\n\n\n\n\n\n4- As you see the ram increase from 12GB to 25GB.\n\n\n\n\n\n\nThis is Google_Colab.pdf πŸ‘‡\n\n\nhttps://github.com/yasserhessein/What-is-Google-Colab-and-how-can-I-use-it/blob/main/Google_Colab.pdf", "votes": null } ], "comments": [ { "id": 1338431, "author_name": "jimmycool", "author_url": "", "post_date": "06/06/2021 13:00:47", "content": "

Out of ram error i

", "votes": null, "replies": [] }, { "id": 1339000, "author_name": "faisalalsrheed", "author_url": "", "post_date": "06/06/2021 23:55:50", "content": "

Hi @jimmycool

\n

Are you using GPU or TPU?
\nWhat is the size of your input images?

", "votes": null, "replies": [] }, { "id": 1339053, "author_name": "jimmycool", "author_url": "", "post_date": "06/07/2021 02:08:08", "content": "

I am using Google colab pro with 25 gb ram and the image size is 256,256,3 in RGB format even using just 2000 images from the train dataset it is getting out of memory error

", "votes": null, "replies": [ { "id": 1339665, "author_name": "faisalalsrheed", "author_url": "", "post_date": "06/07/2021 11:37:52", "content": "

inside your code Keep Clearing the Memory Using the del Statement
\nAlong with the gc. collect() method,

\n

https://www.delftstack.com/howto/python/python-clear-memory/

", "votes": null, "replies": [] } ] }, { "id": 1339601, "author_name": "eakdag", "author_url": "", "post_date": "06/07/2021 10:55:58", "content": "

Did you try to decrease your batch size to fit into the memory? You can also try to make it work with smaller model instead of B7.

", "votes": null, "replies": [] }, { "id": 1340369, "author_name": "yasserhessein", "author_url": "", "post_date": "06/07/2021 20:17:41", "content": "

The memory is not enough you can buy memory or u can got free 😊 if u need just 25 GB

\n

1- U can check this😊

\n

i = []
\nwhile True:
\n i.append(i)

\n

\n

2- Wait for few minutes, after that you will get a prompt that your notebook got crashed, do you want to increase ram ?

\n

3- In the prompt click - yes

\n

\n

4- As you see the ram increase from 12GB to 25GB.

\n

\n

This is Google_Colab.pdf πŸ‘‡

\n

https://github.com/yasserhessein/What-is-Google-Colab-and-how-can-I-use-it/blob/main/Google_Colab.pdf

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "1338407": "My deep neural network models such as effnetb7 are getting timed out in google colab with 25 gb of ram what can we do resolve the issue.How much ram does kaggle use in the final submission.Is it 16 gb", "1338431": "Out of ram error i", "1339000": "Hi @jimmycool \n\nAre you using GPU or TPU? \nWhat is the size of your input images?", "1339053": "I am using Google colab pro with 25 gb ram and the image size is 256,256,3 in RGB format even using just 2000 images from the train dataset it is getting out of memory error", "1339601": "Did you try to decrease your batch size to fit into the memory? You can also try to make it work with smaller model instead of B7.", "1339665": "inside your code Keep Clearing the Memory Using the `del ` Statement\nAlong with the ` gc. collect()` method, \n\nhttps://www.delftstack.com/howto/python/python-clear-memory/", "1340369": "The memory is not enough you can buy memory or u can got free 😊 if u need just 25 GB \n\n\n 1- U can check this😊 \n\ni = []\nwhile True:\n i.append(i)\n\n\n\n2- Wait for few minutes, after that you will get a prompt that your notebook got crashed, do you want to increase ram ?\n\n\n\n3- In the prompt click - yes\n\n\n\n\n\n\n\n4- As you see the ram increase from 12GB to 25GB.\n\n\n\n\n\n\nThis is Google_Colab.pdf πŸ‘‡\n\n\nhttps://github.com/yasserhessein/What-is-Google-Colab-and-how-can-I-use-it/blob/main/Google_Colab.pdf" }, "source": "meta" }