{
  "id": 26597,
  "title": "Problems downloading image data",
  "url": "/competitions/dstl-satellite-imagery-feature-detection/discussion/26597",
  "author_name": "",
  "post_date": "2016-12-16T22:35:27.373Z",
  "votes": null,
  "comment_count": 3,
  "views": 255,
  "content": "<p>Hi folks,</p>\n\n<p>I've tried and failed to download the three_band.zip and the sixteen_band.zip data from the links on the data tab. I set off the download (which Firefox tells me should take somewhere between 11 hours and 1 day) and continue with my life. When I check again a few hours later, the downloads have failed and I'm left with .part files in my downloads folder, roughly 3GB in size.</p>\n\n<p>Has anyone else had this problem, and does anyone have a solution for this?</p>\n\n<p>Thanks!</p>",
  "messages": [
    {
      "id": "150829",
      "postDate": "12/16/2016 22:35:27",
      "content": "<p>Hi folks,</p>\n\n<p>I've tried and failed to download the three_band.zip and the sixteen_band.zip data from the links on the data tab. I set off the download (which Firefox tells me should take somewhere between 11 hours and 1 day) and continue with my life. When I check again a few hours later, the downloads have failed and I'm left with .part files in my downloads folder, roughly 3GB in size.</p>\n\n<p>Has anyone else had this problem, and does anyone have a solution for this?</p>\n\n<p>Thanks!</p>",
      "rawMarkdown": "Hi folks,\r\n\r\nI've tried and failed to download the three_band.zip and the sixteen_band.zip data from the links on the data tab. I set off the download (which Firefox tells me should take somewhere between 11 hours and 1 day) and continue with my life. When I check again a few hours later, the downloads have failed and I'm left with .part files in my downloads folder, roughly 3GB in size.\r\n\r\nHas anyone else had this problem, and does anyone have a solution for this?\r\n\r\nThanks!",
      "votes": null
    },
    {
      "id": "150853",
      "postDate": "12/17/2016 02:40:53",
      "content": "<p>Indeed it's a pain downloading huge files. Especially when there are connection issues. \nI used \"wget\" to download the dataset with an option \"-c\" for resuming capability in case the download fails.</p>\n\n<p>You would need to save the cookies in the page using a chrome extension\n<a href=\"https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh\">Chrome Extension</a></p>\n\n<p>save the cookies as cookies.txt from the extension</p>\n\n<p>Then you can download the files by using the following command</p>\n\n<pre><code>wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/data?train_wkt.csv.zip\n</code></pre>",
      "rawMarkdown": "Indeed it's a pain downloading huge files. Especially when there are connection issues. \r\nI used \"wget\" to download the dataset with an option \"-c\" for resuming capability in case the download fails.\r\n\r\nYou would need to save the cookies in the page using a chrome extension\r\n[Chrome Extension][1]\r\n\r\nsave the cookies as cookies.txt from the extension\r\n\r\nThen you can download the files by using the following command\r\n\r\n    wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/data?train_wkt.csv.zip\r\n\r\n\r\n  [1]: https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh",
      "votes": null
    },
    {
      "id": "150893",
      "postDate": "12/17/2016 11:44:41",
      "content": "<p>That's brilliant, thanks! I ended up getting the equivalent Firefox extension <a href=\"https://addons.mozilla.org/en-US/firefox/addon/export-cookies/\">here</a>, then using:</p>\n\n<pre><code>wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/download/sixteen_band.zip\n</code></pre>\n\n<p>Now all I need to do is hang around for the next 30 hours for it to finish downloading. Aaaaaaand then get started on the 3-band images. Which are almost twice the size. *sigh*</p>",
      "rawMarkdown": "That's brilliant, thanks! I ended up getting the equivalent Firefox extension [here][1], then using:\r\n\r\n    wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/download/sixteen_band.zip\r\n\r\nNow all I need to do is hang around for the next 30 hours for it to finish downloading. Aaaaaaand then get started on the 3-band images. Which are almost twice the size. \\*sigh\\*\r\n\r\n  [1]: https://addons.mozilla.org/en-US/firefox/addon/export-cookies/",
      "votes": null
    },
    {
      "id": "158751",
      "postDate": "01/29/2017 22:02:24",
      "content": "<p>Hi everyone,</p>\n\n<p>May be someone has answer, Why \"Kaggle\" don't organize downloading such huge data sets through torrents ?</p>\n\n<p>I suppose, that's good way to save money for them and one of the best way to download it for us.</p>",
      "rawMarkdown": "Hi everyone,\r\n\r\nMay be someone has answer, Why \"Kaggle\" don't organize downloading such huge data sets through torrents ?\r\n\r\nI suppose, that's good way to save money for them and one of the best way to download it for us.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 150853,
      "author_name": "anjithgeorge",
      "author_url": "",
      "post_date": "12/17/2016 02:40:53",
      "content": "<p>Indeed it's a pain downloading huge files. Especially when there are connection issues. \nI used \"wget\" to download the dataset with an option \"-c\" for resuming capability in case the download fails.</p>\n\n<p>You would need to save the cookies in the page using a chrome extension\n<a href=\"https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh\">Chrome Extension</a></p>\n\n<p>save the cookies as cookies.txt from the extension</p>\n\n<p>Then you can download the files by using the following command</p>\n\n<pre><code>wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/data?train_wkt.csv.zip\n</code></pre>",
      "votes": null,
      "replies": []
    },
    {
      "id": 150893,
      "author_name": "benlomax",
      "author_url": "",
      "post_date": "12/17/2016 11:44:41",
      "content": "<p>That's brilliant, thanks! I ended up getting the equivalent Firefox extension <a href=\"https://addons.mozilla.org/en-US/firefox/addon/export-cookies/\">here</a>, then using:</p>\n\n<pre><code>wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/download/sixteen_band.zip\n</code></pre>\n\n<p>Now all I need to do is hang around for the next 30 hours for it to finish downloading. Aaaaaaand then get started on the 3-band images. Which are almost twice the size. *sigh*</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 158751,
      "author_name": "exfool",
      "author_url": "",
      "post_date": "01/29/2017 22:02:24",
      "content": "<p>Hi everyone,</p>\n\n<p>May be someone has answer, Why \"Kaggle\" don't organize downloading such huge data sets through torrents ?</p>\n\n<p>I suppose, that's good way to save money for them and one of the best way to download it for us.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "150829": "Hi folks,\r\n\r\nI've tried and failed to download the three_band.zip and the sixteen_band.zip data from the links on the data tab. I set off the download (which Firefox tells me should take somewhere between 11 hours and 1 day) and continue with my life. When I check again a few hours later, the downloads have failed and I'm left with .part files in my downloads folder, roughly 3GB in size.\r\n\r\nHas anyone else had this problem, and does anyone have a solution for this?\r\n\r\nThanks!",
    "150853": "Indeed it's a pain downloading huge files. Especially when there are connection issues. \r\nI used \"wget\" to download the dataset with an option \"-c\" for resuming capability in case the download fails.\r\n\r\nYou would need to save the cookies in the page using a chrome extension\r\n[Chrome Extension][1]\r\n\r\nsave the cookies as cookies.txt from the extension\r\n\r\nThen you can download the files by using the following command\r\n\r\n    wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/data?train_wkt.csv.zip\r\n\r\n\r\n  [1]: https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh",
    "150893": "That's brilliant, thanks! I ended up getting the equivalent Firefox extension [here][1], then using:\r\n\r\n    wget -c -x --load-cookies cookies.txt https://www.kaggle.com/c/dstl-satellite-imagery-feature-detection/download/sixteen_band.zip\r\n\r\nNow all I need to do is hang around for the next 30 hours for it to finish downloading. Aaaaaaand then get started on the 3-band images. Which are almost twice the size. \\*sigh\\*\r\n\r\n  [1]: https://addons.mozilla.org/en-US/firefox/addon/export-cookies/",
    "158751": "Hi everyone,\r\n\r\nMay be someone has answer, Why \"Kaggle\" don't organize downloading such huge data sets through torrents ?\r\n\r\nI suppose, that's good way to save money for them and one of the best way to download it for us."
  },
  "source": "meta"
}