recently i am facing some issue dont know what happened but kaggle gpu seems to work slow for some models here i am using effb7ns is anyone also facing this issue ?
\nKaggle Gpu Tesla P100-PCIE… , CUDA Version: 11.0 :-
\nEpoch:1, loss: 1.265: 26%
\n176/694 [10:33<31:16, 3.62s/it]
Colab Gpu Tesla V100-SXM2… , CUDA Version: 11.2 :-
\nEpoch:1, loss: 0.895: 100%
\n694/694 [07:45<00:00, 1.21it/s]
Colab Gpu Tesla P100-PCIE… , CUDA Version: 11.2 :-
\nEpoch:1, loss: 0.720: 100%
\n694/694 [10:55<00:00, 1.25it/s]
recently i am facing some issue dont know what happened but kaggle gpu seems to work slow for some models here i am using effb7ns is anyone also facing this issue ?
\nKaggle Gpu Tesla P100-PCIE… , CUDA Version: 11.0 :-
\nEpoch:1, loss: 1.265: 26%
\n176/694 [10:33<31:16, 3.62s/it]
Colab Gpu Tesla V100-SXM2… , CUDA Version: 11.2 :-
\nEpoch:1, loss: 0.895: 100%
\n694/694 [07:45<00:00, 1.21it/s]
Colab Gpu Tesla P100-PCIE… , CUDA Version: 11.2 :-
\nEpoch:1, loss: 0.720: 100%
\n694/694 [10:55<00:00, 1.25it/s]
Tesla V100 in Google colab!!! Is it in pro version?
", "rawMarkdown": "Tesla V100 in Google colab!!! Is it in pro version?", "votes": null }, { "id": "1363573", "postDate": "06/24/2021 07:54:38", "content": "It should be due to GPU type V100 and P100.
\nIf I understand correctly, Colab p100 and Kaggle p100 are taking the similar time (10:55 and 10:53) But TeslaV100 is faster in Colab.
yes pro version
", "rawMarkdown": "yes pro version", "votes": null }, { "id": "1363582", "postDate": "06/24/2021 07:57:16", "content": "no it has completed 26% only lol and time taken was 10:33
", "rawMarkdown": "no it has completed 26% only lol and time taken was 10:33", "votes": null }, { "id": "1363592", "postDate": "06/24/2021 08:04:56", "content": "aa ok my bad. Maybe you miss something tiny. Because I also run the same model and it was much faster than you shared indeed
", "rawMarkdown": "aa ok my bad. Maybe you miss something tiny. Because I also run the same model and it was much faster than you shared indeed", "votes": null }, { "id": "1363597", "postDate": "06/24/2021 08:06:16", "content": "yeah i have added external data
", "rawMarkdown": "yeah i have added external data", "votes": null }, { "id": "1363638", "postDate": "06/24/2021 08:31:43", "content": "@eakdag can you tell how much time is it taking for you to complete one epoch with effb7ns and image size = 512
", "rawMarkdown": "eakdag can you tell how much time is it taking for you to complete one epoch with effb7ns and image size = 512", "votes": null }, { "id": "1363664", "postDate": "06/24/2021 08:46:48", "content": "In TPU 1 epoch is around 1 min. I could not find the GPU version(most probably deleted) but I remember that I switched to TPU as it is really quick. I suggest you as well.
", "rawMarkdown": "In TPU 1 epoch is around 1 min. I could not find the GPU version(most probably deleted) but I remember that I switched to TPU as it is really quick. I suggest you as well.", "votes": null }, { "id": "1363691", "postDate": "06/24/2021 09:17:52", "content": "Thanx for the suggestion are you using tf ? becuase i was using torch xla earlier when i switched to tpu 8 cores the time was slightly better then gpu version but it was having high idle time so i didnt used may be i am doing something wrong thanx again :)
", "rawMarkdown": "Thanx for the suggestion are you using tf ? becuase i was using torch xla earlier when i switched to tpu 8 cores the time was slightly better then gpu version but it was having high idle time so i didnt used may be i am doing something wrong thanx again :)", "votes": null }, { "id": "1364092", "postDate": "06/24/2021 15:54:54", "content": "V100 > P100 > Kaggle Notebook in my experiments (speed order).
", "rawMarkdown": "V100 > P100 > Kaggle Notebook in my experiments (speed order).", "votes": null }, { "id": "1364149", "postDate": "06/24/2021 16:53:19", "content": "hmm p100 in kaggle > 30mins , p100 in colab = 10-11 min approx thats a lot of difference though
", "rawMarkdown": "hmm p100 in kaggle > 30mins , p100 in colab = 10-11 min approx thats a lot of difference though", "votes": null }, { "id": "1366289", "postDate": "06/26/2021 16:10:20", "content": "How much is colab pro costing you? Is it good? @trooperog
", "rawMarkdown": "How much is colab pro costing you? Is it good? @trooperog", "votes": null }, { "id": "1366304", "postDate": "06/26/2021 16:29:47", "content": "@saurabhbagchi it cost me a total of 875 INR or 11.79 USD for one month subscription , its original price is 9.99 usd but 1.8 USD was added due to GST , yes i think its good but remember that it also has time limit but most of the time it is < 15 hours for a single run in my experimentations , and can ban you for using gpu for 12 hours to 24 hours if you do long run very oftenwhich i always do lol and also you can get v100 but sometime you get p100 but i have some hacks/tricks to get v100 most of the time and also its p100 is >> p100 in kaggle as you can see the perfomance above and also you will have a total of 149 gb disk space with ram upto 24 gb .
", "rawMarkdown": "saurabhbagchi it cost me a total of 875 INR or 11.79 USD for one month subscription , its original price is 9.99 usd but 1.8 USD was added due to GST , yes i think its good but remember that it also has time limit but most of the time it is < 15 hours for a single run in my experimentations , and can ban you for using gpu for 12 hours to 24 hours if you do long run very oftenwhich i always do lol and also you can get v100 but sometime you get p100 but i have some hacks/tricks to get v100 most of the time and also its p100 is >> p100 in kaggle as you can see the perfomance above and also you will have a total of 149 gb disk space with ram upto 24 gb .", "votes": null }, { "id": "1366312", "postDate": "06/26/2021 16:40:04", "content": "Thanks @trooperog , this is very useful information!
", "rawMarkdown": "Thanks @trooperog , this is very useful information!", "votes": null } ], "comments": [ { "id": 1363572, "author_name": "raghaw", "author_url": "", "post_date": "06/24/2021 07:54:30", "content": "Tesla V100 in Google colab!!! Is it in pro version?
", "votes": null, "replies": [ { "id": 1363577, "author_name": "trooperog", "author_url": "", "post_date": "06/24/2021 07:56:07", "content": "yes pro version
", "votes": null, "replies": [] }, { "id": 1366289, "author_name": "saurabhbagchi", "author_url": "", "post_date": "06/26/2021 16:10:20", "content": "How much is colab pro costing you? Is it good? @trooperog
", "votes": null, "replies": [] }, { "id": 1366304, "author_name": "trooperog", "author_url": "", "post_date": "06/26/2021 16:29:47", "content": "@saurabhbagchi it cost me a total of 875 INR or 11.79 USD for one month subscription , its original price is 9.99 usd but 1.8 USD was added due to GST , yes i think its good but remember that it also has time limit but most of the time it is < 15 hours for a single run in my experimentations , and can ban you for using gpu for 12 hours to 24 hours if you do long run very oftenwhich i always do lol and also you can get v100 but sometime you get p100 but i have some hacks/tricks to get v100 most of the time and also its p100 is >> p100 in kaggle as you can see the perfomance above and also you will have a total of 149 gb disk space with ram upto 24 gb .
", "votes": null, "replies": [] }, { "id": 1366312, "author_name": "saurabhbagchi", "author_url": "", "post_date": "06/26/2021 16:40:04", "content": "Thanks @trooperog , this is very useful information!
", "votes": null, "replies": [] } ] }, { "id": 1363573, "author_name": "eakdag", "author_url": "", "post_date": "06/24/2021 07:54:38", "content": "It should be due to GPU type V100 and P100.
\nIf I understand correctly, Colab p100 and Kaggle p100 are taking the similar time (10:55 and 10:53) But TeslaV100 is faster in Colab.
no it has completed 26% only lol and time taken was 10:33
", "votes": null, "replies": [] }, { "id": 1363592, "author_name": "eakdag", "author_url": "", "post_date": "06/24/2021 08:04:56", "content": "aa ok my bad. Maybe you miss something tiny. Because I also run the same model and it was much faster than you shared indeed
", "votes": null, "replies": [] }, { "id": 1363597, "author_name": "trooperog", "author_url": "", "post_date": "06/24/2021 08:06:16", "content": "yeah i have added external data
", "votes": null, "replies": [] }, { "id": 1363638, "author_name": "trooperog", "author_url": "", "post_date": "06/24/2021 08:31:43", "content": "@eakdag can you tell how much time is it taking for you to complete one epoch with effb7ns and image size = 512
", "votes": null, "replies": [] }, { "id": 1363664, "author_name": "eakdag", "author_url": "", "post_date": "06/24/2021 08:46:48", "content": "In TPU 1 epoch is around 1 min. I could not find the GPU version(most probably deleted) but I remember that I switched to TPU as it is really quick. I suggest you as well.
", "votes": null, "replies": [] }, { "id": 1363691, "author_name": "trooperog", "author_url": "", "post_date": "06/24/2021 09:17:52", "content": "Thanx for the suggestion are you using tf ? becuase i was using torch xla earlier when i switched to tpu 8 cores the time was slightly better then gpu version but it was having high idle time so i didnt used may be i am doing something wrong thanx again :)
", "votes": null, "replies": [] } ] }, { "id": 1364092, "author_name": "drtausamaru", "author_url": "", "post_date": "06/24/2021 15:54:54", "content": "V100 > P100 > Kaggle Notebook in my experiments (speed order).
", "votes": null, "replies": [ { "id": 1364149, "author_name": "trooperog", "author_url": "", "post_date": "06/24/2021 16:53:19", "content": "hmm p100 in kaggle > 30mins , p100 in colab = 10-11 min approx thats a lot of difference though
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "1363566": "recently i am facing some issue dont know what happened but kaggle gpu seems to work slow for some models here i am using effb7ns is anyone also facing this issue ? \n\nKaggle Gpu Tesla P100-PCIE... , CUDA Version: 11.0 :- \nEpoch:1, loss: 1.265: 26%\n176/694 [10:33<31:16, 3.62s/it]\n\nColab Gpu Tesla V100-SXM2... , CUDA Version: 11.2 :- \nEpoch:1, loss: 0.895: 100%\n694/694 [07:45<00:00, 1.21it/s] \n\nColab Gpu Tesla P100-PCIE... , CUDA Version: 11.2 :- \nEpoch:1, loss: 0.720: 100%\n694/694 [10:55<00:00, 1.25it/s]", "1363572": "Tesla V100 in Google colab!!! Is it in pro version?", "1363573": "It should be due to GPU type V100 and P100. \nIf I understand correctly, Colab p100 and Kaggle p100 are taking the similar time (10:55 and 10:53) But TeslaV100 is faster in Colab.", "1363577": "yes pro version", "1363582": "no it has completed 26% only lol and time taken was 10:33", "1363592": "aa ok my bad. Maybe you miss something tiny. Because I also run the same model and it was much faster than you shared indeed", "1363597": "yeah i have added external data", "1363638": "eakdag can you tell how much time is it taking for you to complete one epoch with effb7ns and image size = 512", "1363664": "In TPU 1 epoch is around 1 min. I could not find the GPU version(most probably deleted) but I remember that I switched to TPU as it is really quick. I suggest you as well.", "1363691": "Thanx for the suggestion are you using tf ? becuase i was using torch xla earlier when i switched to tpu 8 cores the time was slightly better then gpu version but it was having high idle time so i didnt used may be i am doing something wrong thanx again :)", "1364092": "V100 > P100 > Kaggle Notebook in my experiments (speed order).", "1364149": "hmm p100 in kaggle > 30mins , p100 in colab = 10-11 min approx thats a lot of difference though", "1366289": "How much is colab pro costing you? Is it good? @trooperog", "1366304": "saurabhbagchi it cost me a total of 875 INR or 11.79 USD for one month subscription , its original price is 9.99 usd but 1.8 USD was added due to GST , yes i think its good but remember that it also has time limit but most of the time it is < 15 hours for a single run in my experimentations , and can ban you for using gpu for 12 hours to 24 hours if you do long run very oftenwhich i always do lol and also you can get v100 but sometime you get p100 but i have some hacks/tricks to get v100 most of the time and also its p100 is >> p100 in kaggle as you can see the perfomance above and also you will have a total of 149 gb disk space with ram upto 24 gb .", "1366312": "Thanks @trooperog , this is very useful information!" }, "source": "meta" }