{
  "id": 15313,
  "title": "Downloading data",
  "url": "/competitions/diabetic-retinopathy-detection/discussion/15313",
  "author_name": "",
  "post_date": "2015-07-17T07:14:57.313Z",
  "votes": 5,
  "comment_count": 5,
  "views": 1434,
  "content": "<p>All -</p>\n\n<p>I had go through some hickups in getting data into a server using wget for this competition. Hope this helps any one in my situation.</p>\n\n<ol>\n<li>I used this plugin on chrome to get cookie data (<a href=\"https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh\">https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh</a>)</li>\n<li>save it as cookies.txt</li>\n<li>Upload the cookies.txt on your server</li>\n<li><p>Now use wget to download files:</p>\n\n<p>wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001</a>\nwget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005</a></p></li>\n</ol>",
  "messages": [
    {
      "id": "85775",
      "postDate": "07/17/2015 07:14:57",
      "content": "<p>All -</p>\n\n<p>I had go through some hickups in getting data into a server using wget for this competition. Hope this helps any one in my situation.</p>\n\n<ol>\n<li>I used this plugin on chrome to get cookie data (<a href=\"https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh\">https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh</a>)</li>\n<li>save it as cookies.txt</li>\n<li>Upload the cookies.txt on your server</li>\n<li><p>Now use wget to download files:</p>\n\n<p>wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001</a>\nwget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004</a>\n wget -x --load-cookies cookies.txt <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005\">https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005</a></p></li>\n</ol>",
      "rawMarkdown": "All -\r\n\r\nI had go through some hickups in getting data into a server using wget for this competition. Hope this helps any one in my situation.\r\n\r\n1. I used this plugin on chrome to get cookie data (https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh)\r\n2. save it as cookies.txt\r\n3. Upload the cookies.txt on your server\r\n4. Now use wget to download files:\r\n\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001\r\n    wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005",
      "votes": null
    },
    {
      "id": "85828",
      "postDate": "07/17/2015 13:28:01",
      "content": "<p>Great!</p>\n\n<p>Firefox has the Export Cookies extension to get the cookies.txt file</p>",
      "rawMarkdown": "Great!\r\n\r\nFirefox has the Export Cookies extension to get the cookies.txt file",
      "votes": null
    },
    {
      "id": "85834",
      "postDate": "07/17/2015 13:43:58",
      "content": "<p>If you don't want to use any extensions, just start downloading the file in your browser, cancel it, copy the link from your &quot;Downloads&quot; tab and use that link to simply wget / curl it. (You probably need quotes around the url.)</p>",
      "rawMarkdown": "If you don't want to use any extensions, just start downloading the file in your browser, cancel it, copy the link from your \"Downloads\" tab and use that link to simply wget / curl it. (You probably need quotes around the url.)",
      "votes": null
    },
    {
      "id": "85858",
      "postDate": "07/17/2015 17:53:07",
      "content": "<p>This has also been discussed in another <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/forums/t/12542/faster-download-of-dataset/68562#post68562\">thread</a>.</p>\n\n<p>You can do it without any cookie extension and with wget only in two lines. Replace <code>yourUsername</code> and <code>yourPassword</code> with your credentials.</p>\n\n<p><code>\nwget --save-cookies cookies.txt --keep-session-cookies --post-data 'username=yourUsername&amp;password=yourPassword&#8217; http://www.kaggle.com/account/login\n</code>  </p>\n\n<p><code>\nwget -x -c --load-cookies cookies.txt -P data -nH --cut-dirs=5 https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.00{1..5}\n</code></p>",
      "rawMarkdown": "This has also been discussed in another [thread](https://www.kaggle.com/c/diabetic-retinopathy-detection/forums/t/12542/faster-download-of-dataset/68562#post68562).\r\n\r\nYou can do it without any cookie extension and with wget only in two lines. Replace ```yourUsername``` and ```yourPassword``` with your credentials.\r\n\r\n```\r\nwget --save-cookies cookies.txt --keep-session-cookies --post-data 'username=yourUsername&password=yourPassword’ http://www.kaggle.com/account/login\r\n```  \r\n\r\n```\r\nwget -x -c --load-cookies cookies.txt -P data -nH --cut-dirs=5 https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.00{1..5}\r\n```",
      "votes": null
    },
    {
      "id": "158146",
      "postDate": "01/25/2017 18:51:54",
      "content": "<p>I have the another way of downloading archives:</p>\n\n<ol>\n<li>Install this <a href=\"http://www.freedownloadmanager.org/\">http://www.freedownloadmanager.org/</a></li>\n<li>Install chrome extension: <a href=\"https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp\">https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp</a></li>\n<li>Click on .zip data files</li>\n</ol>\n\n<p>Hope it will help</p>",
      "rawMarkdown": "I have the another way of downloading archives:\r\n\r\n1. Install this http://www.freedownloadmanager.org/\r\n2. Install chrome extension: https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp\r\n3. Click on .zip data files\r\n\r\nHope it will help",
      "votes": null
    },
    {
      "id": "165826",
      "postDate": "03/07/2017 09:02:57",
      "content": "<p>BEST WAY TO DOWNLOAD DATA AT YOUR PROVIDED INTERNET SPEED</p>\n\n<p>step - I click on download the file and press Ctrl + j and cancel download right click to copy link address </p>\n\n<p>step - II then go to <a href=\"http://savetodrive.net/#\">http://savetodrive.net/#</a>  and authenticate the user from the gdrive and paste the link address in the provided space for \"ENTER THE URL\" and it will download the file on your gdrive at the speed of 15 to 20Mbps and as gdrive has the best server to download the files you are able to download at high speed </p>\n\n<p>(I will recommend to download the data from gdrive use IDM as download will not break in between and you can able to pause the download)</p>",
      "rawMarkdown": "BEST WAY TO DOWNLOAD DATA AT YOUR PROVIDED INTERNET SPEED\n\nstep - I click on download the file and press Ctrl + j and cancel download right click to copy link address \n\nstep - II then go to http://savetodrive.net/#  and authenticate the user from the gdrive and paste the link address in the provided space for \"ENTER THE URL\" and it will download the file on your gdrive at the speed of 15 to 20Mbps and as gdrive has the best server to download the files you are able to download at high speed \n\n(I will recommend to download the data from gdrive use IDM as download will not break in between and you can able to pause the download)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 85828,
      "author_name": "guillaumecherel",
      "author_url": "",
      "post_date": "07/17/2015 13:28:01",
      "content": "<p>Great!</p>\n\n<p>Firefox has the Export Cookies extension to get the cookies.txt file</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 85834,
      "author_name": "jeffreydf",
      "author_url": "",
      "post_date": "07/17/2015 13:43:58",
      "content": "<p>If you don't want to use any extensions, just start downloading the file in your browser, cancel it, copy the link from your &quot;Downloads&quot; tab and use that link to simply wget / curl it. (You probably need quotes around the url.)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 85858,
      "author_name": "timothyman",
      "author_url": "",
      "post_date": "07/17/2015 17:53:07",
      "content": "<p>This has also been discussed in another <a href=\"https://www.kaggle.com/c/diabetic-retinopathy-detection/forums/t/12542/faster-download-of-dataset/68562#post68562\">thread</a>.</p>\n\n<p>You can do it without any cookie extension and with wget only in two lines. Replace <code>yourUsername</code> and <code>yourPassword</code> with your credentials.</p>\n\n<p><code>\nwget --save-cookies cookies.txt --keep-session-cookies --post-data 'username=yourUsername&amp;password=yourPassword&#8217; http://www.kaggle.com/account/login\n</code>  </p>\n\n<p><code>\nwget -x -c --load-cookies cookies.txt -P data -nH --cut-dirs=5 https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.00{1..5}\n</code></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 158146,
      "author_name": "mtitkov",
      "author_url": "",
      "post_date": "01/25/2017 18:51:54",
      "content": "<p>I have the another way of downloading archives:</p>\n\n<ol>\n<li>Install this <a href=\"http://www.freedownloadmanager.org/\">http://www.freedownloadmanager.org/</a></li>\n<li>Install chrome extension: <a href=\"https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp\">https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp</a></li>\n<li>Click on .zip data files</li>\n</ol>\n\n<p>Hope it will help</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 165826,
      "author_name": "prashantdhiman",
      "author_url": "",
      "post_date": "03/07/2017 09:02:57",
      "content": "<p>BEST WAY TO DOWNLOAD DATA AT YOUR PROVIDED INTERNET SPEED</p>\n\n<p>step - I click on download the file and press Ctrl + j and cancel download right click to copy link address </p>\n\n<p>step - II then go to <a href=\"http://savetodrive.net/#\">http://savetodrive.net/#</a>  and authenticate the user from the gdrive and paste the link address in the provided space for \"ENTER THE URL\" and it will download the file on your gdrive at the speed of 15 to 20Mbps and as gdrive has the best server to download the files you are able to download at high speed </p>\n\n<p>(I will recommend to download the data from gdrive use IDM as download will not break in between and you can able to pause the download)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "85775": "All -\r\n\r\nI had go through some hickups in getting data into a server using wget for this competition. Hope this helps any one in my situation.\r\n\r\n1. I used this plugin on chrome to get cookie data (https://chrome.google.com/webstore/detail/cookietxt-export/lopabhfecdfhgogdbojmaicoicjekelh)\r\n2. save it as cookies.txt\r\n3. Upload the cookies.txt on your server\r\n4. Now use wget to download files:\r\n\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.001\r\n    wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.002\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.003\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.004\r\n     wget -x --load-cookies cookies.txt https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.005",
    "85828": "Great!\r\n\r\nFirefox has the Export Cookies extension to get the cookies.txt file",
    "85834": "If you don't want to use any extensions, just start downloading the file in your browser, cancel it, copy the link from your \"Downloads\" tab and use that link to simply wget / curl it. (You probably need quotes around the url.)",
    "85858": "This has also been discussed in another [thread](https://www.kaggle.com/c/diabetic-retinopathy-detection/forums/t/12542/faster-download-of-dataset/68562#post68562).\r\n\r\nYou can do it without any cookie extension and with wget only in two lines. Replace ```yourUsername``` and ```yourPassword``` with your credentials.\r\n\r\n```\r\nwget --save-cookies cookies.txt --keep-session-cookies --post-data 'username=yourUsername&password=yourPassword’ http://www.kaggle.com/account/login\r\n```  \r\n\r\n```\r\nwget -x -c --load-cookies cookies.txt -P data -nH --cut-dirs=5 https://www.kaggle.com/c/diabetic-retinopathy-detection/download/train.zip.00{1..5}\r\n```",
    "158146": "I have the another way of downloading archives:\r\n\r\n1. Install this http://www.freedownloadmanager.org/\r\n2. Install chrome extension: https://chrome.google.com/webstore/detail/free-download-manager-chr/ahmpjcflkgiildlgicmcieglgoilbfdp\r\n3. Click on .zip data files\r\n\r\nHope it will help",
    "165826": "BEST WAY TO DOWNLOAD DATA AT YOUR PROVIDED INTERNET SPEED\n\nstep - I click on download the file and press Ctrl + j and cancel download right click to copy link address \n\nstep - II then go to http://savetodrive.net/#  and authenticate the user from the gdrive and paste the link address in the provided space for \"ENTER THE URL\" and it will download the file on your gdrive at the speed of 15 to 20Mbps and as gdrive has the best server to download the files you are able to download at high speed \n\n(I will recommend to download the data from gdrive use IDM as download will not break in between and you can able to pause the download)"
  },
  "source": "meta"
}