{
  "id": 145972,
  "title": "How to access data in Colab",
  "url": "/competitions/deepfake-detection-challenge/discussion/145972",
  "author_name": "",
  "post_date": "2020-04-25T10:34:36.678829600Z",
  "votes": null,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Beginner here.\nWe are trying to get started with this challenge by working on colab notebooks. So we uploaded the zip files on google drive, but now we are unable to extract the contents of those zipfiles, due to their large size. We tried manual extraction by connecting the third party apps on google drive, zip file too large. We tried via cmd line too, \"unzip\", \"jar xf\", and \"7z\", these three commands were tried, but these too failed, probably because of the large size of zip file. So how should we go about getting the extracted data on google drive?\nOr is there a better alternative than Colab?</p>",
  "messages": [
    {
      "id": "820317",
      "postDate": "04/25/2020 10:34:36",
      "content": "<p>Beginner here.\nWe are trying to get started with this challenge by working on colab notebooks. So we uploaded the zip files on google drive, but now we are unable to extract the contents of those zipfiles, due to their large size. We tried manual extraction by connecting the third party apps on google drive, zip file too large. We tried via cmd line too, \"unzip\", \"jar xf\", and \"7z\", these three commands were tried, but these too failed, probably because of the large size of zip file. So how should we go about getting the extracted data on google drive?\nOr is there a better alternative than Colab?</p>",
      "rawMarkdown": "Beginner here.\nWe are trying to get started with this challenge by working on colab notebooks. So we uploaded the zip files on google drive, but now we are unable to extract the contents of those zipfiles, due to their large size. We tried manual extraction by connecting the third party apps on google drive, zip file too large. We tried via cmd line too, \"unzip\", \"jar xf\", and \"7z\", these three commands were tried, but these too failed, probably because of the large size of zip file. So how should we go about getting the extracted data on google drive?\nOr is there a better alternative than Colab?",
      "votes": null
    },
    {
      "id": "821038",
      "postDate": "04/25/2020 21:19:24",
      "content": "<p>Easiest way for me was using CurlWget: <a href=\"https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg\">https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg</a></p>\n\n<p>Copy the command and run it in a colab notebook, make sure to disable the extension once done with it else it'll mess up normal downloads, the command has a time limit of about 2 days since it uses a token that expires.</p>",
      "rawMarkdown": "Easiest way for me was using CurlWget: https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg\n\nCopy the command and run it in a colab notebook, make sure to disable the extension once done with it else it'll mess up normal downloads, the command has a time limit of about 2 days since it uses a token that expires.",
      "votes": null
    },
    {
      "id": "821046",
      "postDate": "04/25/2020 21:36:02",
      "content": "<p>Ok, I'll check it out. Hope this solves the issue.</p>",
      "rawMarkdown": "Ok, I'll check it out. Hope this solves the issue.",
      "votes": null
    },
    {
      "id": "821055",
      "postDate": "04/25/2020 21:45:21",
      "content": "<p>This helps to get the command for downloading the Kaggle data (zipped files) into the google drive, right? I already have downloaded the data to google drive. But the problem is that every unzipping app is unable to unzip such a large (~9GB) file. How did you unzip after downloading the files?</p>",
      "rawMarkdown": "This helps to get the command for downloading the Kaggle data (zipped files) into the google drive, right? I already have downloaded the data to google drive. But the problem is that every unzipping app is unable to unzip such a large (~9GB) file. How did you unzip after downloading the files?",
      "votes": null
    },
    {
      "id": "821072",
      "postDate": "04/25/2020 22:14:23",
      "content": "<p>Colab won't have enough storage space to hold all the data. You're better off with local machine/storage or use some cloud platform.</p>",
      "rawMarkdown": "Colab won't have enough storage space to hold all the data. You're better off with local machine/storage or use some cloud platform.",
      "votes": null
    },
    {
      "id": "829676",
      "postDate": "05/02/2020 02:17:44",
      "content": "<p>Upload zip to gdrive\nMount gdrive in colab\nRun \"!unzip '/gdrive/My Drive/{filename here}' \"</p>",
      "rawMarkdown": "Upload zip to gdrive\nMount gdrive in colab\nRun \"!unzip '/gdrive/My Drive/{filename here}' \"",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 821038,
      "author_name": "greatgamedota",
      "author_url": "",
      "post_date": "04/25/2020 21:19:24",
      "content": "<p>Easiest way for me was using CurlWget: <a href=\"https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg\">https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg</a></p>\n\n<p>Copy the command and run it in a colab notebook, make sure to disable the extension once done with it else it'll mess up normal downloads, the command has a time limit of about 2 days since it uses a token that expires.</p>",
      "votes": null,
      "replies": [
        {
          "id": 821046,
          "author_name": "mavericksumit",
          "author_url": "",
          "post_date": "04/25/2020 21:36:02",
          "content": "<p>Ok, I'll check it out. Hope this solves the issue.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 821055,
          "author_name": "mavericksumit",
          "author_url": "",
          "post_date": "04/25/2020 21:45:21",
          "content": "<p>This helps to get the command for downloading the Kaggle data (zipped files) into the google drive, right? I already have downloaded the data to google drive. But the problem is that every unzipping app is unable to unzip such a large (~9GB) file. How did you unzip after downloading the files?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 821072,
          "author_name": "greatgamedota",
          "author_url": "",
          "post_date": "04/25/2020 22:14:23",
          "content": "<p>Colab won't have enough storage space to hold all the data. You're better off with local machine/storage or use some cloud platform.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 829676,
      "author_name": "marclaugharn",
      "author_url": "",
      "post_date": "05/02/2020 02:17:44",
      "content": "<p>Upload zip to gdrive\nMount gdrive in colab\nRun \"!unzip '/gdrive/My Drive/{filename here}' \"</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "820317": "Beginner here.\nWe are trying to get started with this challenge by working on colab notebooks. So we uploaded the zip files on google drive, but now we are unable to extract the contents of those zipfiles, due to their large size. We tried manual extraction by connecting the third party apps on google drive, zip file too large. We tried via cmd line too, \"unzip\", \"jar xf\", and \"7z\", these three commands were tried, but these too failed, probably because of the large size of zip file. So how should we go about getting the extracted data on google drive?\nOr is there a better alternative than Colab?",
    "821038": "Easiest way for me was using CurlWget: https://chrome.google.com/webstore/detail/curlwget/jmocjfidanebdlinpbcdkcmgdifblncg\n\nCopy the command and run it in a colab notebook, make sure to disable the extension once done with it else it'll mess up normal downloads, the command has a time limit of about 2 days since it uses a token that expires.",
    "821046": "Ok, I'll check it out. Hope this solves the issue.",
    "821055": "This helps to get the command for downloading the Kaggle data (zipped files) into the google drive, right? I already have downloaded the data to google drive. But the problem is that every unzipping app is unable to unzip such a large (~9GB) file. How did you unzip after downloading the files?",
    "821072": "Colab won't have enough storage space to hold all the data. You're better off with local machine/storage or use some cloud platform.",
    "829676": "Upload zip to gdrive\nMount gdrive in colab\nRun \"!unzip '/gdrive/My Drive/{filename here}' \""
  },
  "source": "meta"
}