{
  "id": 32702,
  "title": "wget the huge 7z data file (linux)",
  "url": "/competitions/noaa-fisheries-steller-sea-lion-population-count/discussion/32702",
  "author_name": "",
  "post_date": "2017-05-08T15:04:04.745430200Z",
  "votes": 5,
  "comment_count": 2,
  "views": 0,
  "content": "<h1>login and save authentication cookie (change [kaggle-email] and [kaggle-password])</h1>\n\n<p>wget --save-cookies cookies.txt --post-data 'username=kaggle-email&amp;password=kaggle-password&amp;rememberme=true' <a href=\"https://www.kaggle.com/account/login?isModal=true\">https://www.kaggle.com/account/login?isModal=true</a></p>\n\n<h1>aria2 significantly sped up things for me (~X7)</h1>\n\n<p>sudo apt install aria2</p>\n\n<h1>This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option (as an authenticated user)</h1>\n\n<p>aria2c -c -x 16 -s 16 --load-cookies cookies.txt -p <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z</a></p>",
  "messages": [
    {
      "id": "181114",
      "postDate": "05/08/2017 15:04:04",
      "content": "<h1>login and save authentication cookie (change [kaggle-email] and [kaggle-password])</h1>\n\n<p>wget --save-cookies cookies.txt --post-data 'username=kaggle-email&amp;password=kaggle-password&amp;rememberme=true' <a href=\"https://www.kaggle.com/account/login?isModal=true\">https://www.kaggle.com/account/login?isModal=true</a></p>\n\n<h1>aria2 significantly sped up things for me (~X7)</h1>\n\n<p>sudo apt install aria2</p>\n\n<h1>This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option (as an authenticated user)</h1>\n\n<p>aria2c -c -x 16 -s 16 --load-cookies cookies.txt -p <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z</a></p>",
      "rawMarkdown": "# login and save authentication cookie (change [kaggle-email] and [kaggle-password])\nwget --save-cookies cookies.txt --post-data 'username=kaggle-email&password=kaggle-password&rememberme=true' https://www.kaggle.com/account/login?isModal=true\n\n# aria2 significantly sped up things for me (~X7)\nsudo apt install aria2\n\n# This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option (as an authenticated user)\naria2c -c -x 16 -s 16 --load-cookies cookies.txt -p https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z",
      "votes": null
    },
    {
      "id": "181124",
      "postDate": "05/08/2017 15:25:48",
      "content": "<h1>If you'd like to speed up over wget, try aria2</h1>\n\n<p>sudo apt install aria2</p>\n\n<h1>Instead of doing the actual download with wget, replace the 2nd line with:</h1>\n\n<p><strong>aria2c -c -x 16 -s 16</strong> --load-cookies cookies.txt -p <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z</a></p>\n\n<h1>This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option</h1>",
      "rawMarkdown": "# If you'd like to speed up over wget, try aria2\nsudo apt install aria2\n# Instead of doing the actual download with wget, replace the 2nd line with:\n**aria2c -c -x 16 -s 16** --load-cookies cookies.txt -p https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\n# This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option",
      "votes": null
    },
    {
      "id": "181186",
      "postDate": "05/08/2017 18:51:24",
      "content": "<p>I recommend for training using the dataset I created. Each is 64x64 RGB photos of each sea lion with its class in a CSV\n<a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671</a></p>",
      "rawMarkdown": "I recommend for training using the dataset I created. Each is 64x64 RGB photos of each sea lion with its class in a CSV\n[https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671][1]\n\n\n  [1]: https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 181124,
      "author_name": "morkrispil",
      "author_url": "",
      "post_date": "05/08/2017 15:25:48",
      "content": "<h1>If you'd like to speed up over wget, try aria2</h1>\n\n<p>sudo apt install aria2</p>\n\n<h1>Instead of doing the actual download with wget, replace the 2nd line with:</h1>\n\n<p><strong>aria2c -c -x 16 -s 16</strong> --load-cookies cookies.txt -p <a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z</a></p>\n\n<h1>This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option</h1>",
      "votes": null,
      "replies": []
    },
    {
      "id": 181186,
      "author_name": "kingburrito666",
      "author_url": "",
      "post_date": "05/08/2017 18:51:24",
      "content": "<p>I recommend for training using the dataset I created. Each is 64x64 RGB photos of each sea lion with its class in a CSV\n<a href=\"https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671\">https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "181114": "# login and save authentication cookie (change [kaggle-email] and [kaggle-password])\nwget --save-cookies cookies.txt --post-data 'username=kaggle-email&password=kaggle-password&rememberme=true' https://www.kaggle.com/account/login?isModal=true\n\n# aria2 significantly sped up things for me (~X7)\nsudo apt install aria2\n\n# This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option (as an authenticated user)\naria2c -c -x 16 -s 16 --load-cookies cookies.txt -p https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z",
    "181124": "# If you'd like to speed up over wget, try aria2\nsudo apt install aria2\n# Instead of doing the actual download with wget, replace the 2nd line with:\n**aria2c -c -x 16 -s 16** --load-cookies cookies.txt -p https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/download/KaggleNOAASeaLions.7z\n# This will initiate 16 concurrent connections, each downloading a 1/16 split, with a \"reconnect\" option",
    "181186": "I recommend for training using the dataset I created. Each is 64x64 RGB photos of each sea lion with its class in a CSV\n[https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671][1]\n\n\n  [1]: https://www.kaggle.com/c/noaa-fisheries-steller-sea-lion-population-count/discussion/32671"
  },
  "source": "meta"
}