{
  "id": 62464,
  "title": "help me please  ",
  "url": "/competitions/airbus-ship-detection/discussion/62464",
  "author_name": "",
  "post_date": "2018-08-01T23:00:20.720187100Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>hi everybody,\nhow can i download datasets in google colab.</p>",
  "messages": [
    {
      "id": "365106",
      "postDate": "08/01/2018 23:00:20",
      "content": "<p>hi everybody,\nhow can i download datasets in google colab.</p>",
      "rawMarkdown": "hi everybody,\nhow can i download datasets in google colab.",
      "votes": null
    },
    {
      "id": "365206",
      "postDate": "08/02/2018 05:34:59",
      "content": "<p>Not to free one. It is 26 GB and Colab uses you Google storage (17GB for free).</p>\n\n<p>If you have paid plan, which allows you to accomodate more data, i do not see reason why not. </p>",
      "rawMarkdown": "Not to free one. It is 26 GB and Colab uses you Google storage (17GB for free).\n\nIf you have paid plan, which allows you to accomodate more data, i do not see reason why not.",
      "votes": null
    },
    {
      "id": "371661",
      "postDate": "08/17/2018 10:57:52",
      "content": "<p>This response is a bit late but for the benefit of those who may come across this thread, this is one way to easily transfer competition data from Kaggle to Colab:</p>\n\n<p>Enter the following code into a Colab jupyter notebook cell:</p>\n\n<pre><code># install kaggle cli\n!pip install kaggle-cli\n\n# then download competion files from kaggle\n!kg download -u yourkaggleusername -p yourkagglepassword -c nameofcompetition\n\n# see a list of all files\n!ls\n</code></pre>",
      "rawMarkdown": "This response is a bit late but for the benefit of those who may come across this thread, this is one way to easily transfer competition data from Kaggle to Colab:\n\nEnter the following code into a Colab jupyter notebook cell:\n\n    # install kaggle cli\n    !pip install kaggle-cli\n    \n    # then download competion files from kaggle\n    !kg download -u yourkaggleusername -p yourkagglepassword -c nameofcompetition\n    \n    # see a list of all files\n    !ls",
      "votes": null
    },
    {
      "id": "371724",
      "postDate": "08/17/2018 14:26:31",
      "content": "<p>You might find it difficult to download the dataset to Colab. You could download it to your 'Google Drive' and connect you notebook to drive with this code.</p>\n\n<pre><code>!apt-get install -y -qq software-properties-common python-software-properties module-init-tools\n!add-apt-repository -y ppa:alessandro-strada/ppa 2&amp;gt;&amp;amp;1 &amp;gt; /dev/null\n!apt-get update -qq 2&amp;gt;&amp;amp;1 &amp;gt; /dev/null\n!apt-get -y install -qq google-drive-ocamlfuse fuse\n\nfrom google.colab import auth\nauth.authenticate_user()\nfrom oauth2client.client import GoogleCredentials\ncreds = GoogleCredentials.get_application_default()\n\nimport getpass\n!google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret} &amp;lt; /dev/null 2&amp;gt;&amp;amp;1 |    \ngrep URL\nvcode = getpass.getpass()\n!echo {vcode} | google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret}\n\n!mkdir -p drive\n!google-drive-ocamlfuse drive\n</code></pre>\n\n<p>You would require to run this code everytime you connect to a new notebook or time limit exceeds. \nAnother easier way to connect by using Clouderizer(<a href=\"https://clouderizer.com/\">https://clouderizer.com/</a>). It makes the work much easier.\nAn excellent post to guide you through this is <a href=\"https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604\">https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604</a>.</p>\n\n<p>Hope this helps :)</p>",
      "rawMarkdown": "You might find it difficult to download the dataset to Colab. You could download it to your 'Google Drive' and connect you notebook to drive with this code.\n\n    !apt-get install -y -qq software-properties-common python-software-properties module-init-tools\n    !add-apt-repository -y ppa:alessandro-strada/ppa 2&gt;&amp;1 &gt; /dev/null\n    !apt-get update -qq 2&gt;&amp;1 &gt; /dev/null\n    !apt-get -y install -qq google-drive-ocamlfuse fuse\n    \n    from google.colab import auth\n    auth.authenticate_user()\n    from oauth2client.client import GoogleCredentials\n    creds = GoogleCredentials.get_application_default()\n\n    import getpass\n    !google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret} &lt; /dev/null 2&gt;&amp;1 |    \n    grep URL\n    vcode = getpass.getpass()\n    !echo {vcode} | google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret}\n\n    !mkdir -p drive\n    !google-drive-ocamlfuse drive\n\nYou would require to run this code everytime you connect to a new notebook or time limit exceeds. \nAnother easier way to connect by using Clouderizer(https://clouderizer.com/). It makes the work much easier.\nAn excellent post to guide you through this is https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604.\n\nHope this helps :)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 365206,
      "author_name": "mdyzma",
      "author_url": "",
      "post_date": "08/02/2018 05:34:59",
      "content": "<p>Not to free one. It is 26 GB and Colab uses you Google storage (17GB for free).</p>\n\n<p>If you have paid plan, which allows you to accomodate more data, i do not see reason why not. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 371661,
      "author_name": "vbookshelf",
      "author_url": "",
      "post_date": "08/17/2018 10:57:52",
      "content": "<p>This response is a bit late but for the benefit of those who may come across this thread, this is one way to easily transfer competition data from Kaggle to Colab:</p>\n\n<p>Enter the following code into a Colab jupyter notebook cell:</p>\n\n<pre><code># install kaggle cli\n!pip install kaggle-cli\n\n# then download competion files from kaggle\n!kg download -u yourkaggleusername -p yourkagglepassword -c nameofcompetition\n\n# see a list of all files\n!ls\n</code></pre>",
      "votes": null,
      "replies": []
    },
    {
      "id": 371724,
      "author_name": "kiranscaria",
      "author_url": "",
      "post_date": "08/17/2018 14:26:31",
      "content": "<p>You might find it difficult to download the dataset to Colab. You could download it to your 'Google Drive' and connect you notebook to drive with this code.</p>\n\n<pre><code>!apt-get install -y -qq software-properties-common python-software-properties module-init-tools\n!add-apt-repository -y ppa:alessandro-strada/ppa 2&amp;gt;&amp;amp;1 &amp;gt; /dev/null\n!apt-get update -qq 2&amp;gt;&amp;amp;1 &amp;gt; /dev/null\n!apt-get -y install -qq google-drive-ocamlfuse fuse\n\nfrom google.colab import auth\nauth.authenticate_user()\nfrom oauth2client.client import GoogleCredentials\ncreds = GoogleCredentials.get_application_default()\n\nimport getpass\n!google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret} &amp;lt; /dev/null 2&amp;gt;&amp;amp;1 |    \ngrep URL\nvcode = getpass.getpass()\n!echo {vcode} | google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret}\n\n!mkdir -p drive\n!google-drive-ocamlfuse drive\n</code></pre>\n\n<p>You would require to run this code everytime you connect to a new notebook or time limit exceeds. \nAnother easier way to connect by using Clouderizer(<a href=\"https://clouderizer.com/\">https://clouderizer.com/</a>). It makes the work much easier.\nAn excellent post to guide you through this is <a href=\"https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604\">https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604</a>.</p>\n\n<p>Hope this helps :)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "365106": "hi everybody,\nhow can i download datasets in google colab.",
    "365206": "Not to free one. It is 26 GB and Colab uses you Google storage (17GB for free).\n\nIf you have paid plan, which allows you to accomodate more data, i do not see reason why not.",
    "371661": "This response is a bit late but for the benefit of those who may come across this thread, this is one way to easily transfer competition data from Kaggle to Colab:\n\nEnter the following code into a Colab jupyter notebook cell:\n\n    # install kaggle cli\n    !pip install kaggle-cli\n    \n    # then download competion files from kaggle\n    !kg download -u yourkaggleusername -p yourkagglepassword -c nameofcompetition\n    \n    # see a list of all files\n    !ls",
    "371724": "You might find it difficult to download the dataset to Colab. You could download it to your 'Google Drive' and connect you notebook to drive with this code.\n\n    !apt-get install -y -qq software-properties-common python-software-properties module-init-tools\n    !add-apt-repository -y ppa:alessandro-strada/ppa 2&gt;&amp;1 &gt; /dev/null\n    !apt-get update -qq 2&gt;&amp;1 &gt; /dev/null\n    !apt-get -y install -qq google-drive-ocamlfuse fuse\n    \n    from google.colab import auth\n    auth.authenticate_user()\n    from oauth2client.client import GoogleCredentials\n    creds = GoogleCredentials.get_application_default()\n\n    import getpass\n    !google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret} &lt; /dev/null 2&gt;&amp;1 |    \n    grep URL\n    vcode = getpass.getpass()\n    !echo {vcode} | google-drive-ocamlfuse -headless -id={creds.client_id} -secret={creds.client_secret}\n\n    !mkdir -p drive\n    !google-drive-ocamlfuse drive\n\nYou would require to run this code everytime you connect to a new notebook or time limit exceeds. \nAnother easier way to connect by using Clouderizer(https://clouderizer.com/). It makes the work much easier.\nAn excellent post to guide you through this is https://towardsdatascience.com/fast-ai-lesson-1-on-google-colab-free-gpu-d2af89f53604.\n\nHope this helps :)"
  },
  "source": "meta"
}