{
  "id": 268186,
  "title": "Download the test and train data separately",
  "url": "/competitions/g2net-gravitational-wave-detection/discussion/268186",
  "author_name": "",
  "post_date": "2021-08-26T10:40:59.215332300Z",
  "votes": 6,
  "comment_count": 3,
  "views": 0,
  "content": "<p>When using Colab or other cloud services we only want the train or the test data downloaded separately to save space.<br>\nBelow is how doing it directly from the Kaggle bucket.</p>\n<ol>\n<li>Get the gs name to the competition data</li>\n<li>Use the gsutil to download the specific folder you need.</li>\n</ol>\n<p>Here is a <a href=\"https://www.kaggle.com/kirderf/get-gs-name\" target=\"_blank\">notebook </a> with just four lines of codes needed.</p>\n<p>Happy Kaggling!</p>",
  "messages": [
    {
      "id": "1491381",
      "postDate": "08/26/2021 10:40:59",
      "content": "<p>When using Colab or other cloud services we only want the train or the test data downloaded separately to save space.<br>\nBelow is how doing it directly from the Kaggle bucket.</p>\n<ol>\n<li>Get the gs name to the competition data</li>\n<li>Use the gsutil to download the specific folder you need.</li>\n</ol>\n<p>Here is a <a href=\"https://www.kaggle.com/kirderf/get-gs-name\" target=\"_blank\">notebook </a> with just four lines of codes needed.</p>\n<p>Happy Kaggling!</p>",
      "rawMarkdown": "When using Colab or other cloud services we only want the train or the test data downloaded separately to save space.\nBelow is how doing it directly from the Kaggle bucket.\n1.\tGet the gs name to the competition data\n2.\tUse the gsutil to download the specific folder you need.\n\nHere is a [notebook ](https://www.kaggle.com/kirderf/get-gs-name) with just four lines of codes needed.\n\nHappy Kaggling!",
      "votes": null
    },
    {
      "id": "1491922",
      "postDate": "08/26/2021 18:00:30",
      "content": "<p>Hi, thanks for this. As far as I know colab disk space is 60GB, is there any way to store more data than that ? Except maybe using drive</p>",
      "rawMarkdown": "Hi, thanks for this. As far as I know colab disk space is 60GB, is there any way to store more data than that ? Except maybe using drive",
      "votes": null
    },
    {
      "id": "1492285",
      "postDate": "08/27/2021 04:04:56",
      "content": "<p>I usually get about 150GB from colab pro, using drive is also an option but it slows down training and inference time</p>",
      "rawMarkdown": "I usually get about 150GB from colab pro, using drive is also an option but it slows down training and inference time",
      "votes": null
    },
    {
      "id": "1561002",
      "postDate": "10/27/2021 09:04:02",
      "content": "<p>Hey All,</p>\n<p>Thank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey <a href=\"https://forms.gle/QP9L16niPexozyhu5\" target=\"_blank\">https://forms.gle/QP9L16niPexozyhu5</a>.</p>\n<p>Thank you all,</p>\n<p>Regards,<br>\nChris</p>",
      "rawMarkdown": "Hey All,\n\nThank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey https://forms.gle/QP9L16niPexozyhu5.\n\nThank you all,\n\nRegards,\nChris",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1491922,
      "author_name": "zarif98sjs",
      "author_url": "",
      "post_date": "08/26/2021 18:00:30",
      "content": "<p>Hi, thanks for this. As far as I know colab disk space is 60GB, is there any way to store more data than that ? Except maybe using drive</p>",
      "votes": null,
      "replies": [
        {
          "id": 1492285,
          "author_name": "mrigendraagrawal",
          "author_url": "",
          "post_date": "08/27/2021 04:04:56",
          "content": "<p>I usually get about 150GB from colab pro, using drive is also an option but it slows down training and inference time</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1561002,
      "author_name": "zerafachris",
      "author_url": "",
      "post_date": "10/27/2021 09:04:02",
      "content": "<p>Hey All,</p>\n<p>Thank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey <a href=\"https://forms.gle/QP9L16niPexozyhu5\" target=\"_blank\">https://forms.gle/QP9L16niPexozyhu5</a>.</p>\n<p>Thank you all,</p>\n<p>Regards,<br>\nChris</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1491381": "When using Colab or other cloud services we only want the train or the test data downloaded separately to save space.\nBelow is how doing it directly from the Kaggle bucket.\n1.\tGet the gs name to the competition data\n2.\tUse the gsutil to download the specific folder you need.\n\nHere is a [notebook ](https://www.kaggle.com/kirderf/get-gs-name) with just four lines of codes needed.\n\nHappy Kaggling!",
    "1491922": "Hi, thanks for this. As far as I know colab disk space is 60GB, is there any way to store more data than that ? Except maybe using drive",
    "1492285": "I usually get about 150GB from colab pro, using drive is also an option but it slows down training and inference time",
    "1561002": "Hey All,\n\nThank you all for taking part in our competition. The participation has been overwhelmingly positive. We are currently conducting a survey to gauge the demographic and outreach achieved. Kindly spare 2min and fill in this survey https://forms.gle/QP9L16niPexozyhu5.\n\nThank you all,\n\nRegards,\nChris"
  },
  "source": "meta"
}