{
  "id": 105816,
  "title": "Anyone uses Google Colab pls help.",
  "url": "/competitions/aptos2019-blindness-detection/discussion/105816",
  "author_name": "",
  "post_date": "2019-08-26T16:07:48.879167400Z",
  "votes": 1,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Hi, due to the recent GPU limit by Kaggle, I tried to use Google Colab. Train and test images file get uploaded as zip files in Google Drive and the '!unzip' snippet takes forever to unzip the file. I even tried using 'CloudConvert' but even for test images zip file it gives error saying 'Zip file too large'. If any1 is successfully using Google Colab then please help me. Thanks </p>",
  "messages": [
    {
      "id": "608320",
      "postDate": "08/26/2019 16:07:48",
      "content": "<p>Hi, due to the recent GPU limit by Kaggle, I tried to use Google Colab. Train and test images file get uploaded as zip files in Google Drive and the '!unzip' snippet takes forever to unzip the file. I even tried using 'CloudConvert' but even for test images zip file it gives error saying 'Zip file too large'. If any1 is successfully using Google Colab then please help me. Thanks </p>",
      "rawMarkdown": "Hi, due to the recent GPU limit by Kaggle, I tried to use Google Colab. Train and test images file get uploaded as zip files in Google Drive and the '!unzip' snippet takes forever to unzip the file. I even tried using 'CloudConvert' but even for test images zip file it gives error saying 'Zip file too large'. If any1 is successfully using Google Colab then please help me. Thanks",
      "votes": null
    },
    {
      "id": "608341",
      "postDate": "08/26/2019 16:35:03",
      "content": "<p>Hi,</p>\n\n<p>I used it but had to change hardware: Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\nWith GPU you'll have 300gb+, while on CPU(default) you have around 30gb I think.</p>",
      "rawMarkdown": "Hi,\n\nI used it but had to change hardware: Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\nWith GPU you'll have 300gb+, while on CPU(default) you have around 30gb I think.",
      "votes": null
    },
    {
      "id": "608392",
      "postDate": "08/26/2019 17:34:10",
      "content": "<p>What? I didn't get you .</p>",
      "rawMarkdown": "What? I didn't get you .",
      "votes": null
    },
    {
      "id": "608393",
      "postDate": "08/26/2019 17:38:29",
      "content": "<p>Before you start downloading and unziping any dataset from kaggle, use the toolbar menu and change the hardware accelerator.</p>\n\n<p>Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.</p>\n\n<p>The kernel will restart with a new environment that has more available disk space.</p>",
      "rawMarkdown": "Before you start downloading and unziping any dataset from kaggle, use the toolbar menu and change the hardware accelerator.\n\nRuntime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\n\nThe kernel will restart with a new environment that has more available disk space.",
      "votes": null
    },
    {
      "id": "608420",
      "postDate": "08/26/2019 18:27:58",
      "content": "<p>I did that bro. The  '!unzip' snippet takes very very long to unzip the file</p>",
      "rawMarkdown": "I did that bro. The  '!unzip' snippet takes very very long to unzip the file",
      "votes": null
    },
    {
      "id": "608435",
      "postDate": "08/26/2019 18:51:01",
      "content": "<p>Than I am not sure what's the matter with your colab 😔 .</p>\n\n<p>The commands I used were:\nfrom google.colab import files\nfiles.upload() # Upload the kaggle.json</p>\n\n<p>!mkdir -p ~/.kaggle\n!cp kaggle.json ~/.kaggle/\n!chmod 600 ~/.kaggle/kaggle.json\n!kaggle competitions download -c aptos2019-blindness-detection</p>\n\n<p>!unzip -q file_name.zip -d output_dir</p>\n\n<p>Just to be sure, check that on the left panel, on tab 'Files' it shows that you have 300gb+ of available space on the bottom of your screen. Hope you figure it all out.</p>",
      "rawMarkdown": "Than I am not sure what's the matter with your colab 😔 .\n\nThe commands I used were:\nfrom google.colab import files\nfiles.upload() # Upload the kaggle.json\n\n!mkdir -p ~/.kaggle\n!cp kaggle.json ~/.kaggle/\n!chmod 600 ~/.kaggle/kaggle.json\n!kaggle competitions download -c aptos2019-blindness-detection\n\n!unzip -q file_name.zip -d output_dir\n\n\nJust to be sure, check that on the left panel, on tab 'Files' it shows that you have 300gb+ of available space on the bottom of your screen. Hope you figure it all out.",
      "votes": null
    },
    {
      "id": "608591",
      "postDate": "08/27/2019 01:46:30",
      "content": "<p>Thanks </p>",
      "rawMarkdown": "Thanks",
      "votes": null
    },
    {
      "id": "738211",
      "postDate": "02/06/2020 09:13:24",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3756321%2Fe12c067e4039d8ecc7706952806c67ea%2FScreenshot%20from%202020-02-06%2010.08.45.png?generation=1580980316521539&amp;alt=media\" alt=\"\"></p>\n\n<p>Anytime I try to download the dataset with colab I get the error  <strong>\"429 - Too Many Requests\"</strong>\nIs there something I'm doing wrong?</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3756321%2Fe12c067e4039d8ecc7706952806c67ea%2FScreenshot%20from%202020-02-06%2010.08.45.png?generation=1580980316521539&amp;alt=media)\n\nAnytime I try to download the dataset with colab I get the error  **\"429 - Too Many Requests\"**\nIs there something I'm doing wrong?",
      "votes": null
    },
    {
      "id": "865561",
      "postDate": "05/28/2020 17:42:14",
      "content": "<p>We can use curlwget option it downloads data much faster than any other technique</p>",
      "rawMarkdown": "We can use curlwget option it downloads data much faster than any other technique",
      "votes": null
    },
    {
      "id": "1309001",
      "postDate": "05/15/2021 15:26:27",
      "content": "<h2>What is Google Colab and how can I use it ?</h2>\n<p>How to Make Use of Google Colab is the platform for you if you want to build a machine learning or deep leraning model but don't have a computer that can handle the workload. Creating a local environment with Anaconda and downloading packages and fixing installation problems is a hassle even if you have a GPU or a decent device.</p>\n<p><img src=\"https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQ-sqIYqq6bC6JfGiQYZOyya7A0W_Ia39GhhQ&amp;usqp=CAU\"></p>\n<h5>This link 👇 all the details</h5>\n<h6><a href=\"https://www.kaggle.com/yasserhessein/what-is-google-colab-and-how-can-i-use-it\" target=\"_blank\">Here ✔️</a></h6>",
      "rawMarkdown": "## What is Google Colab and how can I use it ?\n\nHow to Make Use of Google Colab is the platform for you if you want to build a machine learning or deep leraning model but don't have a computer that can handle the workload. Creating a local environment with Anaconda and downloading packages and fixing installation problems is a hassle even if you have a GPU or a decent device.\n\n<img src=\"https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQ-sqIYqq6bC6JfGiQYZOyya7A0W_Ia39GhhQ&usqp=CAU\" width=\"600px\">\n\n\n\n##### This link 👇 all the details\n\n######  [Here ✔️](https://www.kaggle.com/yasserhessein/what-is-google-colab-and-how-can-i-use-it)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1309001,
      "author_name": "yasserhessein",
      "author_url": "",
      "post_date": "05/15/2021 15:26:27",
      "content": "<h2>What is Google Colab and how can I use it ?</h2>\n<p>How to Make Use of Google Colab is the platform for you if you want to build a machine learning or deep leraning model but don't have a computer that can handle the workload. Creating a local environment with Anaconda and downloading packages and fixing installation problems is a hassle even if you have a GPU or a decent device.</p>\n<p><img src=\"https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQ-sqIYqq6bC6JfGiQYZOyya7A0W_Ia39GhhQ&amp;usqp=CAU\"></p>\n<h5>This link 👇 all the details</h5>\n<h6><a href=\"https://www.kaggle.com/yasserhessein/what-is-google-colab-and-how-can-i-use-it\" target=\"_blank\">Here ✔️</a></h6>",
      "votes": null,
      "replies": []
    },
    {
      "id": 608341,
      "author_name": "ydmeira",
      "author_url": "",
      "post_date": "08/26/2019 16:35:03",
      "content": "<p>Hi,</p>\n\n<p>I used it but had to change hardware: Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\nWith GPU you'll have 300gb+, while on CPU(default) you have around 30gb I think.</p>",
      "votes": null,
      "replies": [
        {
          "id": 608392,
          "author_name": "virajbagal",
          "author_url": "",
          "post_date": "08/26/2019 17:34:10",
          "content": "<p>What? I didn't get you .</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 608393,
          "author_name": "ydmeira",
          "author_url": "",
          "post_date": "08/26/2019 17:38:29",
          "content": "<p>Before you start downloading and unziping any dataset from kaggle, use the toolbar menu and change the hardware accelerator.</p>\n\n<p>Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.</p>\n\n<p>The kernel will restart with a new environment that has more available disk space.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 608420,
          "author_name": "virajbagal",
          "author_url": "",
          "post_date": "08/26/2019 18:27:58",
          "content": "<p>I did that bro. The  '!unzip' snippet takes very very long to unzip the file</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 608435,
          "author_name": "ydmeira",
          "author_url": "",
          "post_date": "08/26/2019 18:51:01",
          "content": "<p>Than I am not sure what's the matter with your colab 😔 .</p>\n\n<p>The commands I used were:\nfrom google.colab import files\nfiles.upload() # Upload the kaggle.json</p>\n\n<p>!mkdir -p ~/.kaggle\n!cp kaggle.json ~/.kaggle/\n!chmod 600 ~/.kaggle/kaggle.json\n!kaggle competitions download -c aptos2019-blindness-detection</p>\n\n<p>!unzip -q file_name.zip -d output_dir</p>\n\n<p>Just to be sure, check that on the left panel, on tab 'Files' it shows that you have 300gb+ of available space on the bottom of your screen. Hope you figure it all out.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 608591,
          "author_name": "virajbagal",
          "author_url": "",
          "post_date": "08/27/2019 01:46:30",
          "content": "<p>Thanks </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 738211,
      "author_name": "jaymaster",
      "author_url": "",
      "post_date": "02/06/2020 09:13:24",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3756321%2Fe12c067e4039d8ecc7706952806c67ea%2FScreenshot%20from%202020-02-06%2010.08.45.png?generation=1580980316521539&amp;alt=media\" alt=\"\"></p>\n\n<p>Anytime I try to download the dataset with colab I get the error  <strong>\"429 - Too Many Requests\"</strong>\nIs there something I'm doing wrong?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 865561,
      "author_name": "chaitu2000",
      "author_url": "",
      "post_date": "05/28/2020 17:42:14",
      "content": "<p>We can use curlwget option it downloads data much faster than any other technique</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "608320": "Hi, due to the recent GPU limit by Kaggle, I tried to use Google Colab. Train and test images file get uploaded as zip files in Google Drive and the '!unzip' snippet takes forever to unzip the file. I even tried using 'CloudConvert' but even for test images zip file it gives error saying 'Zip file too large'. If any1 is successfully using Google Colab then please help me. Thanks",
    "608341": "Hi,\n\nI used it but had to change hardware: Runtime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\nWith GPU you'll have 300gb+, while on CPU(default) you have around 30gb I think.",
    "608392": "What? I didn't get you .",
    "608393": "Before you start downloading and unziping any dataset from kaggle, use the toolbar menu and change the hardware accelerator.\n\nRuntime &gt; Change Runtime Type &gt; Choose GPU on 'Hardware accelerator'.\n\nThe kernel will restart with a new environment that has more available disk space.",
    "608420": "I did that bro. The  '!unzip' snippet takes very very long to unzip the file",
    "608435": "Than I am not sure what's the matter with your colab 😔 .\n\nThe commands I used were:\nfrom google.colab import files\nfiles.upload() # Upload the kaggle.json\n\n!mkdir -p ~/.kaggle\n!cp kaggle.json ~/.kaggle/\n!chmod 600 ~/.kaggle/kaggle.json\n!kaggle competitions download -c aptos2019-blindness-detection\n\n!unzip -q file_name.zip -d output_dir\n\n\nJust to be sure, check that on the left panel, on tab 'Files' it shows that you have 300gb+ of available space on the bottom of your screen. Hope you figure it all out.",
    "608591": "Thanks",
    "738211": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3756321%2Fe12c067e4039d8ecc7706952806c67ea%2FScreenshot%20from%202020-02-06%2010.08.45.png?generation=1580980316521539&amp;alt=media)\n\nAnytime I try to download the dataset with colab I get the error  **\"429 - Too Many Requests\"**\nIs there something I'm doing wrong?",
    "865561": "We can use curlwget option it downloads data much faster than any other technique",
    "1309001": "## What is Google Colab and how can I use it ?\n\nHow to Make Use of Google Colab is the platform for you if you want to build a machine learning or deep leraning model but don't have a computer that can handle the workload. Creating a local environment with Anaconda and downloading packages and fixing installation problems is a hassle even if you have a GPU or a decent device.\n\n<img src=\"https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcQ-sqIYqq6bC6JfGiQYZOyya7A0W_Ia39GhhQ&usqp=CAU\" width=\"600px\">\n\n\n\n##### This link 👇 all the details\n\n######  [Here ✔️](https://www.kaggle.com/yasserhessein/what-is-google-colab-and-how-can-i-use-it)"
  },
  "source": "meta"
}