{
  "id": 149532,
  "title": "Unable to download dataset to Colab",
  "url": "/competitions/imet-2020-fgvc7/discussion/149532",
  "author_name": "",
  "post_date": "2020-05-08T16:53:32.614021700Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>I'm trying to use the Kaggle CLI to download the dataset into my Google Drive for use with Colab: </p>\n\n<p><code>!kaggle competitions download -c imet-2020-fgvc7 -p \"/content/gdrive/My Drive/colab/kaggle\"</code></p>\n\n<p>However, it seems to only download a handful of the files, and then stops with a <code>429 - Too Many Requests</code> error . Any clues about what might be causing this?</p>\n\n<p>I also tried upgrading with <code>!pip install --upgrade kaggle</code>, and received several <code>Requirement already up-to-date</code> or <code>Requirement already satisfied</code> messages. Retrying after this didn't fix the issue either.</p>",
  "messages": [
    {
      "id": "838588",
      "postDate": "05/08/2020 16:53:32",
      "content": "<p>I'm trying to use the Kaggle CLI to download the dataset into my Google Drive for use with Colab: </p>\n\n<p><code>!kaggle competitions download -c imet-2020-fgvc7 -p \"/content/gdrive/My Drive/colab/kaggle\"</code></p>\n\n<p>However, it seems to only download a handful of the files, and then stops with a <code>429 - Too Many Requests</code> error . Any clues about what might be causing this?</p>\n\n<p>I also tried upgrading with <code>!pip install --upgrade kaggle</code>, and received several <code>Requirement already up-to-date</code> or <code>Requirement already satisfied</code> messages. Retrying after this didn't fix the issue either.</p>",
      "rawMarkdown": "I'm trying to use the Kaggle CLI to download the dataset into my Google Drive for use with Colab: \n\n`!kaggle competitions download -c imet-2020-fgvc7 -p \"/content/gdrive/My Drive/colab/kaggle\"`\n\nHowever, it seems to only download a handful of the files, and then stops with a `429 - Too Many Requests` error . Any clues about what might be causing this?\n\nI also tried upgrading with `!pip install --upgrade kaggle`, and received several `Requirement already up-to-date` or `Requirement already satisfied` messages. Retrying after this didn't fix the issue either.",
      "votes": null
    },
    {
      "id": "838918",
      "postDate": "05/08/2020 22:31:40",
      "content": "<p>[self answering] I was able to solve this by doing:</p>\n\n<p><code>\n!pip uninstall -y kaggle\n!pip install --upgrade pip\n!pip install kaggle==1.5.6\n!kaggle -v\n</code></p>\n\n<p>and then retrying <code>!kaggle competitions download -c imet-2020-fgvc7</code></p>",
      "rawMarkdown": "[self answering] I was able to solve this by doing:\n\n```\n!pip uninstall -y kaggle\n!pip install --upgrade pip\n!pip install kaggle==1.5.6\n!kaggle -v\n```\n\nand then retrying `!kaggle competitions download -c imet-2020-fgvc7`",
      "votes": null
    },
    {
      "id": "847542",
      "postDate": "05/14/2020 13:32:46",
      "content": "<p><a href=\"/lakshaysharma\">@lakshaysharma</a> hello, i also saw another way to solve this problem at <a href=\"https://www.kaggle.com/general/51898\">https://www.kaggle.com/general/51898</a> (see Federico González Brizzio message). It work for me. But i have another problem. On colab with GPU i have only 37 GB of free storage, the train dataset is 23 GB so archive 23 GB + files 23 GB = 46 but only 37 free and notebook crashes. Do you know how to solve this problem?</p>",
      "rawMarkdown": "lakshaysharma hello, i also saw another way to solve this problem at https://www.kaggle.com/general/51898 (see Federico González Brizzio message). It work for me. But i have another problem. On colab with GPU i have only 37 GB of free storage, the train dataset is 23 GB so archive 23 GB + files 23 GB = 46 but only 37 free and notebook crashes. Do you know how to solve this problem?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 838918,
      "author_name": "lakshaysharma",
      "author_url": "",
      "post_date": "05/08/2020 22:31:40",
      "content": "<p>[self answering] I was able to solve this by doing:</p>\n\n<p><code>\n!pip uninstall -y kaggle\n!pip install --upgrade pip\n!pip install kaggle==1.5.6\n!kaggle -v\n</code></p>\n\n<p>and then retrying <code>!kaggle competitions download -c imet-2020-fgvc7</code></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 847542,
      "author_name": "yaroslavpoltoran",
      "author_url": "",
      "post_date": "05/14/2020 13:32:46",
      "content": "<p><a href=\"/lakshaysharma\">@lakshaysharma</a> hello, i also saw another way to solve this problem at <a href=\"https://www.kaggle.com/general/51898\">https://www.kaggle.com/general/51898</a> (see Federico González Brizzio message). It work for me. But i have another problem. On colab with GPU i have only 37 GB of free storage, the train dataset is 23 GB so archive 23 GB + files 23 GB = 46 but only 37 free and notebook crashes. Do you know how to solve this problem?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "838588": "I'm trying to use the Kaggle CLI to download the dataset into my Google Drive for use with Colab: \n\n`!kaggle competitions download -c imet-2020-fgvc7 -p \"/content/gdrive/My Drive/colab/kaggle\"`\n\nHowever, it seems to only download a handful of the files, and then stops with a `429 - Too Many Requests` error . Any clues about what might be causing this?\n\nI also tried upgrading with `!pip install --upgrade kaggle`, and received several `Requirement already up-to-date` or `Requirement already satisfied` messages. Retrying after this didn't fix the issue either.",
    "838918": "[self answering] I was able to solve this by doing:\n\n```\n!pip uninstall -y kaggle\n!pip install --upgrade pip\n!pip install kaggle==1.5.6\n!kaggle -v\n```\n\nand then retrying `!kaggle competitions download -c imet-2020-fgvc7`",
    "847542": "lakshaysharma hello, i also saw another way to solve this problem at https://www.kaggle.com/general/51898 (see Federico González Brizzio message). It work for me. But i have another problem. On colab with GPU i have only 37 GB of free storage, the train dataset is 23 GB so archive 23 GB + files 23 GB = 46 but only 37 free and notebook crashes. Do you know how to solve this problem?"
  },
  "source": "meta"
}