{
  "id": 156481,
  "title": "How to Download Large Datasets for Beginners?",
  "url": "/competitions/alaska2-image-steganalysis/discussion/156481",
  "author_name": "",
  "post_date": "2020-06-06T10:39:38.793182700Z",
  "votes": 2,
  "comment_count": 9,
  "views": 0,
  "content": "<p>Hi Kagglers,\nI am quite new to the platform. I would like to know that do you all download the 30 GB data for the Competition and then work or do you use any other means free or paid? Please answer in detail so that I could begin with the conpetition.</p>",
  "messages": [
    {
      "id": "875983",
      "postDate": "06/06/2020 10:39:38",
      "content": "<p>Hi Kagglers,\nI am quite new to the platform. I would like to know that do you all download the 30 GB data for the Competition and then work or do you use any other means free or paid? Please answer in detail so that I could begin with the conpetition.</p>",
      "rawMarkdown": "Hi Kagglers,\nI am quite new to the platform. I would like to know that do you all download the 30 GB data for the Competition and then work or do you use any other means free or paid? Please answer in detail so that I could begin with the conpetition.",
      "votes": null
    },
    {
      "id": "876775",
      "postDate": "06/07/2020 03:28:13",
      "content": "<p>You don’t have to download data incase you are using Kaggle notebook but if you choose use other platform like google colab or your local machine to train model then you have to download the data. If you are not sure how to use kaggle kernel then click on notebooks section of this competition then click on new notebook choose options from script or notebook and you may also select accelerator according to your need .once you create notebook you will see all the data is present under input section .</p>",
      "rawMarkdown": "You don’t have to download data incase you are using Kaggle notebook but if you choose use other platform like google colab or your local machine to train model then you have to download the data. If you are not sure how to use kaggle kernel then click on notebooks section of this competition then click on new notebook choose options from script or notebook and you may also select accelerator according to your need .once you create notebook you will see all the data is present under input section .",
      "votes": null
    },
    {
      "id": "876778",
      "postDate": "06/07/2020 03:32:33",
      "content": "<p>Okk <a href=\"/priyt00\">@priyt00</a> I will work on the Kaggle Notebook. Thank You!</p>",
      "rawMarkdown": "Okk @priyt00 I will work on the Kaggle Notebook. Thank You!",
      "votes": null
    },
    {
      "id": "880482",
      "postDate": "06/10/2020 10:38:15",
      "content": "<p>I've just completed a download to my local system. 😄 </p>",
      "rawMarkdown": "I've just completed a download to my local system. 😄",
      "votes": null
    },
    {
      "id": "880500",
      "postDate": "06/10/2020 10:51:28",
      "content": "<p>That's great <a href=\"/ipythonx\">@ipythonx</a> !! So are you working on your system itself or using Google Colab or any other platform? Will you use GPUs and TPUs?</p>",
      "rawMarkdown": "That's great @ipythonx !! So are you working on your system itself or using Google Colab or any other platform? Will you use GPUs and TPUs?",
      "votes": null
    },
    {
      "id": "880502",
      "postDate": "06/10/2020 10:54:14",
      "content": "<p>All sources, if possible. 😉 </p>",
      "rawMarkdown": "All sources, if possible. 😉",
      "votes": null
    },
    {
      "id": "880506",
      "postDate": "06/10/2020 10:57:44",
      "content": "<p>That's nice!</p>",
      "rawMarkdown": "That's nice!",
      "votes": null
    },
    {
      "id": "885105",
      "postDate": "06/13/2020 21:55:00",
      "content": "<p>Also newcomer here. I just downloaded the whole data set to my local machine. It makes the debugging process easier since I can have a terminal on my local machine. </p>",
      "rawMarkdown": "Also newcomer here. I just downloaded the whole data set to my local machine. It makes the debugging process easier since I can have a terminal on my local machine.",
      "votes": null
    },
    {
      "id": "900240",
      "postDate": "06/24/2020 17:40:49",
      "content": "<p>You can download just small part of data to your local machine for debugging and experiments. Then you can train best model on the whole dataset in kaggle kernel or google colab</p>",
      "rawMarkdown": "You can download just small part of data to your local machine for debugging and experiments. Then you can train best model on the whole dataset in kaggle kernel or google colab",
      "votes": null
    },
    {
      "id": "901296",
      "postDate": "06/25/2020 11:20:25",
      "content": "<p>Hi <a href=\"/aybatov\">@aybatov</a> . Can you please let me know how to download just a part of the data set. I can see only one option to download the complete file and not a part of it. Any help is appreciated.</p>",
      "rawMarkdown": "Hi @aybatov . Can you please let me know how to download just a part of the data set. I can see only one option to download the complete file and not a part of it. Any help is appreciated.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 876775,
      "author_name": "priyt00",
      "author_url": "",
      "post_date": "06/07/2020 03:28:13",
      "content": "<p>You don’t have to download data incase you are using Kaggle notebook but if you choose use other platform like google colab or your local machine to train model then you have to download the data. If you are not sure how to use kaggle kernel then click on notebooks section of this competition then click on new notebook choose options from script or notebook and you may also select accelerator according to your need .once you create notebook you will see all the data is present under input section .</p>",
      "votes": null,
      "replies": [
        {
          "id": 876778,
          "author_name": "ishandutta",
          "author_url": "",
          "post_date": "06/07/2020 03:32:33",
          "content": "<p>Okk <a href=\"/priyt00\">@priyt00</a> I will work on the Kaggle Notebook. Thank You!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 880482,
      "author_name": "ipythonx",
      "author_url": "",
      "post_date": "06/10/2020 10:38:15",
      "content": "<p>I've just completed a download to my local system. 😄 </p>",
      "votes": null,
      "replies": [
        {
          "id": 880500,
          "author_name": "ishandutta",
          "author_url": "",
          "post_date": "06/10/2020 10:51:28",
          "content": "<p>That's great <a href=\"/ipythonx\">@ipythonx</a> !! So are you working on your system itself or using Google Colab or any other platform? Will you use GPUs and TPUs?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 880502,
          "author_name": "ipythonx",
          "author_url": "",
          "post_date": "06/10/2020 10:54:14",
          "content": "<p>All sources, if possible. 😉 </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 880506,
          "author_name": "ishandutta",
          "author_url": "",
          "post_date": "06/10/2020 10:57:44",
          "content": "<p>That's nice!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 885105,
      "author_name": "etudiant233",
      "author_url": "",
      "post_date": "06/13/2020 21:55:00",
      "content": "<p>Also newcomer here. I just downloaded the whole data set to my local machine. It makes the debugging process easier since I can have a terminal on my local machine. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 900240,
      "author_name": "aybatov",
      "author_url": "",
      "post_date": "06/24/2020 17:40:49",
      "content": "<p>You can download just small part of data to your local machine for debugging and experiments. Then you can train best model on the whole dataset in kaggle kernel or google colab</p>",
      "votes": null,
      "replies": [
        {
          "id": 901296,
          "author_name": "ishandutta",
          "author_url": "",
          "post_date": "06/25/2020 11:20:25",
          "content": "<p>Hi <a href=\"/aybatov\">@aybatov</a> . Can you please let me know how to download just a part of the data set. I can see only one option to download the complete file and not a part of it. Any help is appreciated.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "875983": "Hi Kagglers,\nI am quite new to the platform. I would like to know that do you all download the 30 GB data for the Competition and then work or do you use any other means free or paid? Please answer in detail so that I could begin with the conpetition.",
    "876775": "You don’t have to download data incase you are using Kaggle notebook but if you choose use other platform like google colab or your local machine to train model then you have to download the data. If you are not sure how to use kaggle kernel then click on notebooks section of this competition then click on new notebook choose options from script or notebook and you may also select accelerator according to your need .once you create notebook you will see all the data is present under input section .",
    "876778": "Okk @priyt00 I will work on the Kaggle Notebook. Thank You!",
    "880482": "I've just completed a download to my local system. 😄",
    "880500": "That's great @ipythonx !! So are you working on your system itself or using Google Colab or any other platform? Will you use GPUs and TPUs?",
    "880502": "All sources, if possible. 😉",
    "880506": "That's nice!",
    "885105": "Also newcomer here. I just downloaded the whole data set to my local machine. It makes the debugging process easier since I can have a terminal on my local machine.",
    "900240": "You can download just small part of data to your local machine for debugging and experiments. Then you can train best model on the whole dataset in kaggle kernel or google colab",
    "901296": "Hi @aybatov . Can you please let me know how to download just a part of the data set. I can see only one option to download the complete file and not a part of it. Any help is appreciated."
  },
  "source": "meta"
}