{
  "id": 296905,
  "title": "Which Colab for competition ",
  "url": "/competitions/tensorflow-great-barrier-reef/discussion/296905",
  "author_name": "Remek Kinas",
  "post_date": "2021-12-24T07:14:26.143000",
  "votes": 37,
  "comment_count": 39,
  "views": 0,
  "content": "<p>I can see many questions about Colab. Quick comparison by Jeff Heaton I found yesterday.</p>\n<p><img src=\"https://pbs.twimg.com/media/FHOmDcNWQAcCFdL.jpg\" alt=\"Colab\"></p>",
  "messages": [
    {
      "id": 1627791,
      "postDate": "2021-12-24T07:14:26.143Z",
      "content": "<p>I can see many questions about Colab. Quick comparison by Jeff Heaton I found yesterday.</p>\n<p><img src=\"https://pbs.twimg.com/media/FHOmDcNWQAcCFdL.jpg\" alt=\"Colab\"></p>",
      "rawMarkdown": "I can see many questions about Colab. Quick comparison by Jeff Heaton I found yesterday.\n\n![Colab](https://pbs.twimg.com/media/FHOmDcNWQAcCFdL.jpg)",
      "votes": 36
    },
    {
      "id": 1630929,
      "postDate": "2021-12-27T21:17:01.790Z",
      "content": "<p>Sorry I'm a bit OOC here. How does Colab compare with Kaggle's notebooks?</p>",
      "rawMarkdown": "Sorry I'm a bit OOC here. How does Colab compare with Kaggle's notebooks?",
      "votes": 1
    },
    {
      "id": 1629927,
      "postDate": "2021-12-26T18:26:35.967Z",
      "content": "<p>I think that Colab Pro is a bit better, right?</p>",
      "rawMarkdown": "I think that Colab Pro is a bit better, right?",
      "votes": 1,
      "replies": [
        {
          "id": 1629928,
          "postDate": "2021-12-26T18:32:41.430Z",
          "content": "<p>Yes. And Pro+ even better:)</p>",
          "rawMarkdown": "Yes. And Pro+ even better:)"
        }
      ]
    },
    {
      "id": 1628213,
      "postDate": "2021-12-24T16:19:52.517Z",
      "content": "<p>Thanks, <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a>, I'm still debating if I need to upgrade my colab from pro to pro+ or just deploy a VM on GCP, this really will help me in the desicion</p>",
      "rawMarkdown": "Thanks, @remekkinas, I'm still debating if I need to upgrade my colab from pro to pro+ or just deploy a VM on GCP, this really will help me in the desicion",
      "votes": 1,
      "replies": [
        {
          "id": 1628376,
          "postDate": "2021-12-24T18:55:44.110Z",
          "content": "<p>You are welcome :) <br>\nI use Pro+ … why? Run in background help me a lot …. I run a notebook and go sleep … Morning I am sure it is still running … or finished running without interruption. </p>",
          "rawMarkdown": "You are welcome :) \nI use Pro+ ... why? Run in background help me a lot .... I run a notebook and go sleep ... Morning I am sure it is still running ... or finished running without interruption. ",
          "votes": 1
        },
        {
          "id": 1628385,
          "postDate": "2021-12-24T19:08:48.927Z",
          "content": "<p>Thanks, I'm upgrading to Colab Pro+</p>",
          "rawMarkdown": "Thanks, I'm upgrading to Colab Pro+",
          "votes": 1
        },
        {
          "id": 1628391,
          "postDate": "2021-12-24T19:13:59.070Z",
          "content": "<p>I know it is an investment of money after all, but I don't regret it now. The training was repeated many times using the lower version and I had to start all over again. On the Pro + version, you can run 2 instances on the GPU. One of what I remember is in the background and the other is normal. I recommend.</p>",
          "rawMarkdown": "I know it is an investment of money after all, but I don't regret it now. The training was repeated many times using the lower version and I had to start all over again. On the Pro + version, you can run 2 instances on the GPU. One of what I remember is in the background and the other is normal. I recommend.",
          "votes": 2
        },
        {
          "id": 1628619,
          "postDate": "2021-12-25T05:18:37.417Z",
          "content": "<p>I played all this afternoon with Colab Pro+; thanks for the advice; I should have switched time ago.</p>",
          "rawMarkdown": "I played all this afternoon with Colab Pro+; thanks for the advice; I should have switched time ago.",
          "votes": 1
        },
        {
          "id": 1629578,
          "postDate": "2021-12-26T10:15:15.500Z",
          "content": "<p>I read that you can use Colab Pro and Pro + only in several countries and very few European countries are on the list. How did you manage to buy the subscription from Poland?</p>",
          "rawMarkdown": "I read that you can use Colab Pro and Pro + only in several countries and very few European countries are on the list. How did you manage to buy the subscription from Poland?"
        },
        {
          "id": 1629588,
          "postDate": "2021-12-26T10:39:01.753Z",
          "content": "<p>I really do not have any problem with subscription in Poland. I don’t see any limitations.</p>",
          "rawMarkdown": "I really do not have any problem with subscription in Poland. I don’t see any limitations."
        }
      ]
    },
    {
      "id": 1628010,
      "postDate": "2021-12-24T12:23:36.817Z",
      "content": "<p>A100 and V100 here on pro+ :) 50/50</p>",
      "rawMarkdown": "A100 and V100 here on pro+ :) 50/50",
      "votes": 1,
      "replies": [
        {
          "id": 1628022,
          "postDate": "2021-12-24T12:39:31.587Z",
          "content": "<p>You are lucky man <a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> This is why you learn NN such fast :) </p>",
          "rawMarkdown": "You are lucky man @lukaszborecki This is why you learn NN such fast :) ",
          "votes": 1
        }
      ]
    },
    {
      "id": 1656604,
      "postDate": "2022-01-19T13:26:30.203Z",
      "content": "<p>I have a purely curious question for the people. I was somewhat afraid of this question made me dumb.. but really really want to know. Why do you use the Colab for competition? Is that the 30 GPU/TPU time in a week in Kaggle is too small for you? Because to me, the Colab is more uncomfortable than the kernel here.. due to I should always mount data whenever I want to use the notebook in Colab..</p>",
      "rawMarkdown": "I have a purely curious question for the people. I was somewhat afraid of this question made me dumb.. but really really want to know. Why do you use the Colab for competition? Is that the 30 GPU/TPU time in a week in Kaggle is too small for you? Because to me, the Colab is more uncomfortable than the kernel here.. due to I should always mount data whenever I want to use the notebook in Colab..",
      "replies": [
        {
          "id": 1668844,
          "postDate": "2022-01-30T05:22:51.407Z",
          "content": "<p>for me it was the folder system. Kaggle's notebook management is horrendous</p>",
          "rawMarkdown": "for me it was the folder system. Kaggle's notebook management is horrendous"
        }
      ]
    },
    {
      "id": 1632001,
      "postDate": "2021-12-29T03:52:22.827Z",
      "content": "<p>Ya! I already tried that Google collab pro ($9.99/mo) is off for Neural Network Training in Computer Vision Projects. If you have a highly complex task to do an background Execution ha go with Google collab pro+ but it is not necessary. </p>\n<p>I think Google Colab pro is off to train a neural network and it has an advantage nonstop run time up to 24 Hours.</p>",
      "rawMarkdown": "Ya! I already tried that Google collab pro ($9.99/mo) is off for Neural Network Training in Computer Vision Projects. If you have a highly complex task to do an background Execution ha go with Google collab pro+ but it is not necessary. \n\nI think Google Colab pro is off to train a neural network and it has an advantage nonstop run time up to 24 Hours.",
      "votes": 2
    },
    {
      "id": 1628898,
      "postDate": "2021-12-25T11:40:57.243Z",
      "content": "<p>The best tutorial for Kaggle API :)</p>\n<p><a href=\"https://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb\" target=\"_blank\">https://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb</a></p>\n<p>API will download data into zip file. </p>",
      "rawMarkdown": "The best tutorial for Kaggle API :)\n\nhttps://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb\n\nAPI will download data into zip file. ",
      "votes": 2
    },
    {
      "id": 1628375,
      "postDate": "2021-12-24T18:51:17.260Z",
      "content": "<p>How to download the competition data (it is about 15GB) to Colab??</p>",
      "rawMarkdown": "How to download the competition data (it is about 15GB) to Colab??",
      "votes": 2,
      "replies": [
        {
          "id": 1628377,
          "postDate": "2021-12-24T18:56:39.317Z",
          "content": "<p>I uploaded it manually - just zip file and unzip it. </p>",
          "rawMarkdown": "I uploaded it manually - just zip file and unzip it. ",
          "votes": 1
        },
        {
          "id": 1628577,
          "postDate": "2021-12-25T04:00:22.593Z",
          "content": "<p>you can use google utility tools to copy data from  kaggle gcs to your google drive.  </p>",
          "rawMarkdown": " you can use google utility tools to copy data from  kaggle gcs to your google drive.  ",
          "votes": 3
        },
        {
          "id": 1636522,
          "postDate": "2022-01-03T02:24:38.380Z",
          "content": "<p>I created a notebook to show how to download data from kaggle to colab(15GB less than 1 minutes) and run the YoloX.<br>\n<a href=\"https://www.kaggle.com/liuzhangzhen/colab-to-run-yolox\" target=\"_blank\">https://www.kaggle.com/liuzhangzhen/colab-to-run-yolox</a></p>\n<p>Here is the github link which included the execution results of colab for your ref: <a href=\"https://github.com/lzziuhh/machine_learning/blob/master/YOLOX_kaggle_cots_demo.ipynb\" target=\"_blank\">https://github.com/lzziuhh/machine_learning/blob/master/YOLOX_kaggle_cots_demo.ipynb</a></p>",
          "rawMarkdown": "I created a notebook to show how to download data from kaggle to colab(15GB less than 1 minutes) and run the YoloX.\nhttps://www.kaggle.com/liuzhangzhen/colab-to-run-yolox\n\nHere is the github link which included the execution results of colab for your ref: https://github.com/lzziuhh/machine_learning/blob/master/YOLOX_kaggle_cots_demo.ipynb",
          "votes": 4
        },
        {
          "id": 1636683,
          "postDate": "2022-01-03T06:56:48.970Z",
          "content": "<p>Great! Thank you for contribution!</p>",
          "rawMarkdown": "Great! Thank you for contribution!",
          "votes": 1
        }
      ]
    },
    {
      "id": 1636270,
      "postDate": "2022-01-02T18:12:33.497Z",
      "content": "<p>I subscribe colab pro+, but I got only P100 since I've subscribed… what's the problem …?<br>\nI tried re-initializing run-time several times 😭</p>",
      "rawMarkdown": "I subscribe colab pro+, but I got only P100 since I've subscribed... what's the problem ...?\nI tried re-initializing run-time several times 😭",
      "replies": [
        {
          "id": 1636280,
          "postDate": "2022-01-02T18:18:55.807Z",
          "content": "<p>This is normal. I had 2 only P100 for 2 weeks and now …. V100.  </p>",
          "rawMarkdown": "This is normal. I had 2 only P100 for 2 weeks and now .... V100.  ",
          "votes": 1
        }
      ]
    },
    {
      "id": 1631182,
      "postDate": "2021-12-28T06:35:58.417Z",
      "content": "<p>Thanks for this, Jeff always has great content. What does Hours of P3.2x large mean?</p>",
      "rawMarkdown": "Thanks for this, Jeff always has great content. What does Hours of P3.2x large mean?",
      "replies": [
        {
          "id": 1631217,
          "postDate": "2021-12-28T07:20:31.597Z",
          "content": "<p>I am guessing only … you can connect Colab to AWS.</p>",
          "rawMarkdown": "I am guessing only ... you can connect Colab to AWS."
        },
        {
          "id": 1631331,
          "postDate": "2021-12-28T09:48:07.220Z",
          "content": "<p>hmm maybe <a href=\"https://www.kaggle.com/jeffheaton\" target=\"_blank\">@jeffheaton</a> will chime in?</p>",
          "rawMarkdown": "hmm maybe @jeffheaton will chime in?"
        },
        {
          "id": 1631486,
          "postDate": "2021-12-28T13:06:38.780Z",
          "content": "<p>Sure, that is the number of hours of an AWS \"p3.2xlarge\" that I could buy for the CoLab monthly fee.  This was the roughest equivalent I could find.</p>",
          "rawMarkdown": "Sure, that is the number of hours of an AWS \"p3.2xlarge\" that I could buy for the CoLab monthly fee.  This was the roughest equivalent I could find.",
          "votes": 2
        },
        {
          "id": 1631487,
          "postDate": "2021-12-28T13:07:51.107Z",
          "content": "<p>Wow <a href=\"https://www.kaggle.com/jeffheaton\" target=\"_blank\">@jeffheaton</a> answer … Good to see you Jeff! Thank you for great Colab summary.</p>",
          "rawMarkdown": "Wow @jeffheaton answer ... Good to see you Jeff! Thank you for great Colab summary.",
          "votes": 1
        },
        {
          "id": 1631575,
          "postDate": "2021-12-28T15:08:03.777Z",
          "content": "<p>ah, thanks! that makes sense and good guess <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a> cheers!</p>",
          "rawMarkdown": "ah, thanks! that makes sense and good guess @remekkinas cheers!",
          "votes": 1
        }
      ]
    },
    {
      "id": 1630468,
      "postDate": "2021-12-27T10:54:29.620Z",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a>, thank you for sharing this helpful comparison.</p>\n<p>I'm currently on the free version of Colab, and I'm looking to upgrade to Colab Pro, but I'm unsure whether it's still possible to use JavaScript tricks to stop the session from disconnecting. I tested some tricks I found online on the free version of Colab, but I got disconnected after 6 or 7 hours because of CAPTCHA test.</p>\n<p>For Colab Pro, does CAPTCHA appear less often, or is there a way to avoid CAPTCHA? Or do I need to upgrade to Colab Pro+, since there's no point having Colab Pro if it disconnects after a few hours? Thank you in advance.</p>",
      "rawMarkdown": "Hi @remekkinas, thank you for sharing this helpful comparison.\n\nI'm currently on the free version of Colab, and I'm looking to upgrade to Colab Pro, but I'm unsure whether it's still possible to use JavaScript tricks to stop the session from disconnecting. I tested some tricks I found online on the free version of Colab, but I got disconnected after 6 or 7 hours because of CAPTCHA test.\n\nFor Colab Pro, does CAPTCHA appear less often, or is there a way to avoid CAPTCHA? Or do I need to upgrade to Colab Pro+, since there's no point having Colab Pro if it disconnects after a few hours? Thank you in advance.",
      "replies": [
        {
          "id": 1630473,
          "postDate": "2021-12-27T11:01:12.630Z",
          "content": "<p>I use Colab Pro+ and do not use java script anymore … It has background mode. In this competition it is really cool feature. As I said … I start training and can:</p>\n<ul>\n<li>go outside, sleep and it works for 24h (because there is 24h limitations)</li>\n<li>run one more notebook with GPU </li>\n<li>run more notebooks without GPU ….</li>\n</ul>\n<p>I often have situations where the environment becomes disconnected. In this case, all you have to do is reconnect and it still works … there is no downtime.</p>",
          "rawMarkdown": "I use Colab Pro+ and do not use java script anymore ... It has background mode. In this competition it is really cool feature. As I said ... I start training and can:\n- go outside, sleep and it works for 24h (because there is 24h limitations)\n- run one more notebook with GPU \n- run more notebooks without GPU ....\n\nI often have situations where the environment becomes disconnected. In this case, all you have to do is reconnect and it still works ... there is no downtime.",
          "votes": 1
        },
        {
          "id": 1630529,
          "postDate": "2021-12-27T12:17:07.907Z",
          "content": "<p>Ok, thank you for the insight.</p>",
          "rawMarkdown": "Ok, thank you for the insight."
        }
      ]
    },
    {
      "id": 1628576,
      "postDate": "2021-12-25T03:58:36.467Z",
      "content": "<p>when I use Kaggle less,  I often got T4/P100 up to around 10hrs a day for colab free.  however, several months already I only can got colab free for K80 and only up to 6 hours a day. </p>",
      "rawMarkdown": "when I use Kaggle less,  I often got T4/P100 up to around 10hrs a day for colab free.  however, several months already I only can got colab free for K80 and only up to 6 hours a day. ",
      "replies": [
        {
          "id": 1628627,
          "postDate": "2021-12-25T05:34:39.170Z",
          "content": "<p>I have never gotten anything but K80 on colab free. But I only started colab a few months ago. Last I heard, google limited colab free to only K80. It'd be nice if we can get P100 on colab free.</p>",
          "rawMarkdown": "I have never gotten anything but K80 on colab free. But I only started colab a few months ago. Last I heard, google limited colab free to only K80. It'd be nice if we can get P100 on colab free."
        },
        {
          "id": 1628981,
          "postDate": "2021-12-25T14:05:57.200Z",
          "content": "<p>That explains the reason.  More users pay for it, so less for colab free.</p>",
          "rawMarkdown": "That explains the reason.  More users pay for it, so less for colab free."
        }
      ]
    },
    {
      "id": 1627926,
      "postDate": "2021-12-24T10:23:18.650Z",
      "content": "<p>I'm using colab pro and mostly got T4 GPU</p>",
      "rawMarkdown": "I'm using colab pro and mostly got T4 GPU",
      "replies": [
        {
          "id": 1627928,
          "postDate": "2021-12-24T10:25:09.043Z",
          "content": "<p>Yes I know ….. <br>\nI use Colab Pro+ and all the time P100 … :)</p>",
          "rawMarkdown": "Yes I know ….. \nI use Colab Pro+ and all the time P100 … :)"
        },
        {
          "id": 1631957,
          "postDate": "2021-12-29T01:36:27.923Z",
          "content": "<p>I mostly got V100 GPU using Colab Pro +</p>",
          "rawMarkdown": "I mostly got V100 GPU using Colab Pro +"
        }
      ]
    },
    {
      "id": 1630159,
      "postDate": "2021-12-27T03:06:48.740Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1630929,
      "author_name": "Diego Gomez",
      "author_url": "",
      "post_date": "2021-12-27T21:17:01.790000",
      "content": "<p>Sorry I'm a bit OOC here. How does Colab compare with Kaggle's notebooks?</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1629927,
      "author_name": "Dino Wun",
      "author_url": "",
      "post_date": "2021-12-26T18:26:35.967000",
      "content": "<p>I think that Colab Pro is a bit better, right?</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1629928,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-26T18:32:41.430000",
          "content": "<p>Yes. And Pro+ even better:)</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1628213,
      "author_name": "C4rl05/V",
      "author_url": "",
      "post_date": "2021-12-24T16:19:52.517000",
      "content": "<p>Thanks, <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a>, I'm still debating if I need to upgrade my colab from pro to pro+ or just deploy a VM on GCP, this really will help me in the desicion</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1628376,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-24T18:55:44.110000",
          "content": "<p>You are welcome :) <br>\nI use Pro+ … why? Run in background help me a lot …. I run a notebook and go sleep … Morning I am sure it is still running … or finished running without interruption. </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1628385,
          "author_name": "C4rl05/V",
          "author_url": "",
          "post_date": "2021-12-24T19:08:48.927000",
          "content": "<p>Thanks, I'm upgrading to Colab Pro+</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1628391,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-24T19:13:59.070000",
          "content": "<p>I know it is an investment of money after all, but I don't regret it now. The training was repeated many times using the lower version and I had to start all over again. On the Pro + version, you can run 2 instances on the GPU. One of what I remember is in the background and the other is normal. I recommend.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1628619,
          "author_name": "C4rl05/V",
          "author_url": "",
          "post_date": "2021-12-25T05:18:37.417000",
          "content": "<p>I played all this afternoon with Colab Pro+; thanks for the advice; I should have switched time ago.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1629578,
          "author_name": "Abcdemi",
          "author_url": "",
          "post_date": "2021-12-26T10:15:15.500000",
          "content": "<p>I read that you can use Colab Pro and Pro + only in several countries and very few European countries are on the list. How did you manage to buy the subscription from Poland?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1629588,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-26T10:39:01.753000",
          "content": "<p>I really do not have any problem with subscription in Poland. I don’t see any limitations.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1628010,
      "author_name": "Lukasz Borecki",
      "author_url": "",
      "post_date": "2021-12-24T12:23:36.817000",
      "content": "<p>A100 and V100 here on pro+ :) 50/50</p>",
      "votes": 1,
      "replies": [
        {
          "id": 1628022,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-24T12:39:31.587000",
          "content": "<p>You are lucky man <a href=\"https://www.kaggle.com/lukaszborecki\" target=\"_blank\">@lukaszborecki</a> This is why you learn NN such fast :) </p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1656604,
      "author_name": "Eugene J. Ryu",
      "author_url": "",
      "post_date": "2022-01-19T13:26:30.203000",
      "content": "<p>I have a purely curious question for the people. I was somewhat afraid of this question made me dumb.. but really really want to know. Why do you use the Colab for competition? Is that the 30 GPU/TPU time in a week in Kaggle is too small for you? Because to me, the Colab is more uncomfortable than the kernel here.. due to I should always mount data whenever I want to use the notebook in Colab..</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1668844,
          "author_name": "aquaright",
          "author_url": "",
          "post_date": "2022-01-30T05:22:51.407000",
          "content": "<p>for me it was the folder system. Kaggle's notebook management is horrendous</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1632001,
      "author_name": "Balasubramaniam",
      "author_url": "",
      "post_date": "2021-12-29T03:52:22.827000",
      "content": "<p>Ya! I already tried that Google collab pro ($9.99/mo) is off for Neural Network Training in Computer Vision Projects. If you have a highly complex task to do an background Execution ha go with Google collab pro+ but it is not necessary. </p>\n<p>I think Google Colab pro is off to train a neural network and it has an advantage nonstop run time up to 24 Hours.</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 1628898,
      "author_name": "Lukasz Borecki",
      "author_url": "",
      "post_date": "2021-12-25T11:40:57.243000",
      "content": "<p>The best tutorial for Kaggle API :)</p>\n<p><a href=\"https://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb\" target=\"_blank\">https://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb</a></p>\n<p>API will download data into zip file. </p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 1628375,
      "author_name": "Ayman Hamed",
      "author_url": "",
      "post_date": "2021-12-24T18:51:17.260000",
      "content": "<p>How to download the competition data (it is about 15GB) to Colab??</p>",
      "votes": 2,
      "replies": [
        {
          "id": 1628377,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-24T18:56:39.317000",
          "content": "<p>I uploaded it manually - just zip file and unzip it. </p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1628577,
          "author_name": "dragon zhang",
          "author_url": "",
          "post_date": "2021-12-25T04:00:22.593000",
          "content": "<p>you can use google utility tools to copy data from  kaggle gcs to your google drive.  </p>",
          "votes": 3,
          "replies": []
        },
        {
          "id": 1636522,
          "author_name": "liuzhangzhen",
          "author_url": "",
          "post_date": "2022-01-03T02:24:38.380000",
          "content": "<p>I created a notebook to show how to download data from kaggle to colab(15GB less than 1 minutes) and run the YoloX.<br>\n<a href=\"https://www.kaggle.com/liuzhangzhen/colab-to-run-yolox\" target=\"_blank\">https://www.kaggle.com/liuzhangzhen/colab-to-run-yolox</a></p>\n<p>Here is the github link which included the execution results of colab for your ref: <a href=\"https://github.com/lzziuhh/machine_learning/blob/master/YOLOX_kaggle_cots_demo.ipynb\" target=\"_blank\">https://github.com/lzziuhh/machine_learning/blob/master/YOLOX_kaggle_cots_demo.ipynb</a></p>",
          "votes": 4,
          "replies": []
        },
        {
          "id": 1636683,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-01-03T06:56:48.970000",
          "content": "<p>Great! Thank you for contribution!</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1636270,
      "author_name": "Sanghoon Kim",
      "author_url": "",
      "post_date": "2022-01-02T18:12:33.497000",
      "content": "<p>I subscribe colab pro+, but I got only P100 since I've subscribed… what's the problem …?<br>\nI tried re-initializing run-time several times 😭</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1636280,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2022-01-02T18:18:55.807000",
          "content": "<p>This is normal. I had 2 only P100 for 2 weeks and now …. V100.  </p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1631182,
      "author_name": "oliver",
      "author_url": "",
      "post_date": "2021-12-28T06:35:58.417000",
      "content": "<p>Thanks for this, Jeff always has great content. What does Hours of P3.2x large mean?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1631217,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-28T07:20:31.597000",
          "content": "<p>I am guessing only … you can connect Colab to AWS.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1631331,
          "author_name": "oliver",
          "author_url": "",
          "post_date": "2021-12-28T09:48:07.220000",
          "content": "<p>hmm maybe <a href=\"https://www.kaggle.com/jeffheaton\" target=\"_blank\">@jeffheaton</a> will chime in?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1631486,
          "author_name": "Jeff Heaton",
          "author_url": "",
          "post_date": "2021-12-28T13:06:38.780000",
          "content": "<p>Sure, that is the number of hours of an AWS \"p3.2xlarge\" that I could buy for the CoLab monthly fee.  This was the roughest equivalent I could find.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1631487,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-28T13:07:51.107000",
          "content": "<p>Wow <a href=\"https://www.kaggle.com/jeffheaton\" target=\"_blank\">@jeffheaton</a> answer … Good to see you Jeff! Thank you for great Colab summary.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1631575,
          "author_name": "oliver",
          "author_url": "",
          "post_date": "2021-12-28T15:08:03.777000",
          "content": "<p>ah, thanks! that makes sense and good guess <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a> cheers!</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1630468,
      "author_name": "Coderrexe",
      "author_url": "",
      "post_date": "2021-12-27T10:54:29.620000",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/remekkinas\" target=\"_blank\">@remekkinas</a>, thank you for sharing this helpful comparison.</p>\n<p>I'm currently on the free version of Colab, and I'm looking to upgrade to Colab Pro, but I'm unsure whether it's still possible to use JavaScript tricks to stop the session from disconnecting. I tested some tricks I found online on the free version of Colab, but I got disconnected after 6 or 7 hours because of CAPTCHA test.</p>\n<p>For Colab Pro, does CAPTCHA appear less often, or is there a way to avoid CAPTCHA? Or do I need to upgrade to Colab Pro+, since there's no point having Colab Pro if it disconnects after a few hours? Thank you in advance.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1630473,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-27T11:01:12.630000",
          "content": "<p>I use Colab Pro+ and do not use java script anymore … It has background mode. In this competition it is really cool feature. As I said … I start training and can:</p>\n<ul>\n<li>go outside, sleep and it works for 24h (because there is 24h limitations)</li>\n<li>run one more notebook with GPU </li>\n<li>run more notebooks without GPU ….</li>\n</ul>\n<p>I often have situations where the environment becomes disconnected. In this case, all you have to do is reconnect and it still works … there is no downtime.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1630529,
          "author_name": "Coderrexe",
          "author_url": "",
          "post_date": "2021-12-27T12:17:07.907000",
          "content": "<p>Ok, thank you for the insight.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1628576,
      "author_name": "dragon zhang",
      "author_url": "",
      "post_date": "2021-12-25T03:58:36.467000",
      "content": "<p>when I use Kaggle less,  I often got T4/P100 up to around 10hrs a day for colab free.  however, several months already I only can got colab free for K80 and only up to 6 hours a day. </p>",
      "votes": 0,
      "replies": [
        {
          "id": 1628627,
          "author_name": "Lime-Cake",
          "author_url": "",
          "post_date": "2021-12-25T05:34:39.170000",
          "content": "<p>I have never gotten anything but K80 on colab free. But I only started colab a few months ago. Last I heard, google limited colab free to only K80. It'd be nice if we can get P100 on colab free.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1628981,
          "author_name": "dragon zhang",
          "author_url": "",
          "post_date": "2021-12-25T14:05:57.200000",
          "content": "<p>That explains the reason.  More users pay for it, so less for colab free.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1627926,
      "author_name": "Phat Tran",
      "author_url": "",
      "post_date": "2021-12-24T10:23:18.650000",
      "content": "<p>I'm using colab pro and mostly got T4 GPU</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1627928,
          "author_name": "Remek Kinas",
          "author_url": "",
          "post_date": "2021-12-24T10:25:09.043000",
          "content": "<p>Yes I know ….. <br>\nI use Colab Pro+ and all the time P100 … :)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1631957,
          "author_name": "C4rl05/V",
          "author_url": "",
          "post_date": "2021-12-29T01:36:27.923000",
          "content": "<p>I mostly got V100 GPU using Colab Pro +</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1630159,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-12-27T03:06:48.740000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1627791": "I can see many questions about Colab. Quick comparison by Jeff Heaton I found yesterday.\n\n![Colab](https://pbs.twimg.com/media/FHOmDcNWQAcCFdL.jpg)",
    "1630929": "Sorry I'm a bit OOC here. How does Colab compare with Kaggle's notebooks?",
    "1629927": "I think that Colab Pro is a bit better, right?",
    "1628213": "Thanks, @remekkinas, I'm still debating if I need to upgrade my colab from pro to pro+ or just deploy a VM on GCP, this really will help me in the desicion",
    "1628010": "A100 and V100 here on pro+ :) 50/50",
    "1656604": "I have a purely curious question for the people. I was somewhat afraid of this question made me dumb.. but really really want to know. Why do you use the Colab for competition? Is that the 30 GPU/TPU time in a week in Kaggle is too small for you? Because to me, the Colab is more uncomfortable than the kernel here.. due to I should always mount data whenever I want to use the notebook in Colab..",
    "1632001": "Ya! I already tried that Google collab pro ($9.99/mo) is off for Neural Network Training in Computer Vision Projects. If you have a highly complex task to do an background Execution ha go with Google collab pro+ but it is not necessary. \n\nI think Google Colab pro is off to train a neural network and it has an advantage nonstop run time up to 24 Hours.",
    "1628898": "The best tutorial for Kaggle API :)\n\nhttps://colab.research.google.com/github/corrieann/kaggle/blob/master/kaggle_api_in_colab.ipynb\n\nAPI will download data into zip file. ",
    "1628375": "How to download the competition data (it is about 15GB) to Colab??",
    "1636270": "I subscribe colab pro+, but I got only P100 since I've subscribed... what's the problem ...?\nI tried re-initializing run-time several times 😭",
    "1631182": "Thanks for this, Jeff always has great content. What does Hours of P3.2x large mean?",
    "1630468": "Hi @remekkinas, thank you for sharing this helpful comparison.\n\nI'm currently on the free version of Colab, and I'm looking to upgrade to Colab Pro, but I'm unsure whether it's still possible to use JavaScript tricks to stop the session from disconnecting. I tested some tricks I found online on the free version of Colab, but I got disconnected after 6 or 7 hours because of CAPTCHA test.\n\nFor Colab Pro, does CAPTCHA appear less often, or is there a way to avoid CAPTCHA? Or do I need to upgrade to Colab Pro+, since there's no point having Colab Pro if it disconnects after a few hours? Thank you in advance.",
    "1628576": "when I use Kaggle less,  I often got T4/P100 up to around 10hrs a day for colab free.  however, several months already I only can got colab free for K80 and only up to 6 hours a day. ",
    "1627926": "I'm using colab pro and mostly got T4 GPU",
    "1630159": ""
  }
}