![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3721797%2F29ab703559f4bbb7d7bc34366f21a899%2FScreenshot%20from%202019-09-17%2016-30-45.png?generation=1568727488099316&alt=media\")
I've got \"404 error\" using the download link. \nI've got \"429 - Too Many Requests\"error when using Kaggle API after some amount of files like host-a004_lidar..........bin.zip were downloaded. \nSo, how can I download data? \nMay be whole data should be zipped because currently there are >4000 files.
I've got \"404 error\" using the download link. \nI've got \"429 - Too Many Requests\"error when using Kaggle API after some amount of files like host-a004_lidar..........bin.zip were downloaded. \nSo, how can I download data? \nMay be whole data should be zipped because currently there are >4000 files.
Also got a \"429 - Too Many Requests\"
\n\nI downloaded via the API: \"kaggle competitions download -c 3d-object-detection-for-autonomous-vehicles\"
\n\nthanks
", "rawMarkdown": "Also got a \"429 - Too Many Requests\"\n\nI downloaded via the API: \"kaggle competitions download -c 3d-object-detection-for-autonomous-vehicles\"\n\nthanks", "votes": 4, "replies": [ { "id": 625268, "postDate": "2019-09-12T21:04:04.233Z", "content": "Same here
", "rawMarkdown": "Same here" } ] }, { "id": 626963, "postDate": "2019-09-15T07:21:47.760Z", "content": "@philculliton is there any way to download the zip file using cli? using the normal cli command loads the file one by one which result in the error stated below.
", "rawMarkdown": "@philculliton is there any way to download the zip file using cli? using the normal cli command loads the file one by one which result in the error stated below. ", "votes": 1, "replies": [ { "id": 627085, "postDate": "2019-09-15T11:38:28.737Z", "content": "Thanks! I believe that's the planned change for when the API issues are fixed. I'll let everyone know when that's working, but it's a bigger change than the problems that have already been fixed.
", "rawMarkdown": "Thanks! I believe that's the planned change for when the API issues are fixed. I'll let everyone know when that's working, but it's a bigger change than the problems that have already been fixed." }, { "id": 627330, "postDate": "2019-09-15T19:32:58.583Z", "content": "The problem is still alive and kicking. can't even load from \"download all\" - too many requests
", "rawMarkdown": "The problem is still alive and kicking. can't even load from \"download all\" - too many requests ", "votes": 1 }, { "id": 627810, "postDate": "2019-09-16T12:14:05.623Z", "content": "I'm sorry to hear that @yuval6967 - thanks for letting us know. I'll pass it along to the team. I think the short-term fix for this may be to wait some time until the too-many API requests aren't a problem anymore, but I'll see if there's some better solution available.
", "rawMarkdown": "I'm sorry to hear that @yuval6967 - thanks for letting us know. I'll pass it along to the team. I think the short-term fix for this may be to wait some time until the too-many API requests aren't a problem anymore, but I'll see if there's some better solution available." } ] }, { "id": 625908, "postDate": "2019-09-13T15:17:54.370Z", "content": "Still getting 429 errors. It's a lot of data to download, and the competition timeline is relatively short. Could you please get this resolved ASAP
", "rawMarkdown": "Still getting 429 errors. It's a lot of data to download, and the competition timeline is relatively short. Could you please get this resolved ASAP", "votes": 1, "replies": [ { "id": 625920, "postDate": "2019-09-13T15:30:18.647Z", "content": "Thanks! We're working on it. For now, the Download All button appears to be working for most users. Please let me know if that's not the case.
", "rawMarkdown": "Thanks! We're working on it. For now, the Download All button appears to be working for most users. Please let me know if that's not the case." }, { "id": 626037, "postDate": "2019-09-13T18:03:40.393Z", "rawMarkdown": "", "isDeleted": true }, { "id": 626054, "postDate": "2019-09-13T18:27:37.280Z", "content": "Thanks @mmregan! I'll let the team know there are still problems with Download All. This currently appears to be a fix propagation issue - please try it again in 30-60 minutes and let me know if it's still happening. We'll keep investigating / working on it!
", "rawMarkdown": "Thanks @mmregan! I'll let the team know there are still problems with Download All. This currently appears to be a fix propagation issue - please try it again in 30-60 minutes and let me know if it's still happening. We'll keep investigating / working on it!" } ] }, { "id": 625274, "postDate": "2019-09-12T21:22:04.310Z", "content": "Hi all! We're working on getting all forms of download working, but the dataset is now available via Download All.
", "rawMarkdown": "Hi all! We're working on getting all forms of download working, but the dataset is now available via Download All.", "votes": 1 }, { "id": 625173, "postDate": "2019-09-12T18:59:27.583Z", "content": "I have tried downloading manually getting 404 page not found\nthen trying kaggle script.\nkaggle script error - 429 - Too Many Requests
", "rawMarkdown": "I have tried downloading manually getting 404 page not found\nthen trying kaggle script.\nkaggle script error - 429 - Too Many Requests\n", "votes": 1 }, { "id": 625118, "postDate": "2019-09-12T18:08:18.583Z", "content": "Thanks for bringing this to our attention. I'll see what can be done.
", "rawMarkdown": "Thanks for bringing this to our attention. I'll see what can be done.", "votes": 1 }, { "id": 639245, "postDate": "2019-10-03T01:00:23.523Z", "content": "Just adding myself to the discussion, I'm having the same problem with de API. Can't use Download All button either.
\n\nThe solution i found was to download the data from here: https://level5.lyft.com/dataset/download-dataset/, in case anyone is still looking for a solution.
\n\nBest regards
", "rawMarkdown": "Just adding myself to the discussion, I'm having the same problem with de API. Can't use Download All button either. \n\nThe solution i found was to download the data from here: https://level5.lyft.com/dataset/download-dataset/, in case anyone is still looking for a solution.\n\nBest regards", "replies": [ { "id": 639248, "postDate": "2019-10-03T01:23:14.897Z", "content": "Hi @amvillalobos - thanks! You're still getting a 429 error with both the API and Download All button?
\n\nThe dataset hosted at the link you mentioned is only the training set, so it doesn't contain everything you need to work on the competition.
", "rawMarkdown": "Hi @amvillalobos - thanks! You're still getting a 429 error with both the API and Download All button?\n\nThe dataset hosted at the link you mentioned is _only_ the training set, so it doesn't contain everything you need to work on the competition." } ] }, { "id": 630144, "postDate": "2019-09-19T19:37:26.190Z", "content": "Thanks for all your feedback, everybody, it was extremely helpful! Sorry for the delay in getting this working, it was a complex issue and required some work from our excellent engineers.
\n\nThe API should work now for download competition data - you just need to update your kaggle library as described [here] (https://www.kaggle.com/c/3d-object-detection-for-autonomous-vehicles/discussion/109523#latest-630142). Let us know if you have any further problems!
I still am getting 429 error\nunable to download data.
", "rawMarkdown": "I still am getting 429 error\nunable to download data." }, { "id": 629426, "postDate": "2019-09-18T19:04:52.920Z", "content": "I downloaded all the data without API and I have problems to extract it on Linux and Windows, it seems to be corrupted.
", "rawMarkdown": "I downloaded all the data without API and I have problems to extract it on Linux and Windows, it seems to be corrupted.", "replies": [ { "id": 630145, "postDate": "2019-09-19T19:38:00.423Z", "content": "I'm sorry to hear that! What kind of problems are you running into?
", "rawMarkdown": "I'm sorry to hear that! What kind of problems are you running into?" } ] }, { "id": 628532, "postDate": "2019-09-17T13:39:47.933Z", "content": "I have the same issue.
\n\n
![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3721797%2F8cf6fca0d73a6c0bd28d5043f62090e9%2FScreenshot%20from%202019-09-17%2016-34-46.png?generation=1568727532636656&alt=media\")
Download All does not work - it says too many requests. \n@philculliton Could you let us know when the planned fix for API will take place?\nThanks so much
", "rawMarkdown": "Download All does not work - it says too many requests. \n@philculliton Could you let us know when the planned fix for API will take place?\nThanks so much", "replies": [ { "id": 627807, "postDate": "2019-09-16T12:12:01.280Z", "content": "Hi @narsil! The API fix will hopefully take place this week - as I understand it, it's a bigger fix than the other pieces. I'll ask about too many requests from the Download All button, but I suspect the short-term fix will be to wait some amount of time until the earlier requests are no longer a problem. (I would guess a few hours?) I'll see if there's something else that can be done.
I got a 404 error when I tried downloading via Chrome on Ubuntu. Got 429 - Too Many Requests when I tried using the Kaggle API.
", "rawMarkdown": "I got a 404 error when I tried downloading via Chrome on Ubuntu. Got 429 - Too Many Requests when I tried using the Kaggle API. ", "replies": [ { "id": 625924, "postDate": "2019-09-13T15:31:50.930Z", "content": "Thanks. I'll let our engineers know we're still seeing problems with Download All. It's likely a fix propagation issue, so in the meantime please give it another try in 30-60 minutes.
", "rawMarkdown": "Thanks. I'll let our engineers know we're still seeing problems with Download All. It's likely a fix propagation issue, so in the meantime please give it another try in 30-60 minutes." }, { "id": 625982, "postDate": "2019-09-13T16:46:52.130Z", "content": "Thank you for the prompt response Phil. One more observation. I noticed that when downloading via the kaggle API, the files aren't in their respective folders. All the files are under the same root directory.
", "rawMarkdown": "Thank you for the prompt response Phil. One more observation. I noticed that when downloading via the kaggle API, the files aren't in their respective folders. All the files are under the same root directory." }, { "id": 626028, "postDate": "2019-09-13T17:46:44.477Z", "content": "Thanks @srirakshith! Yes, this is a problem that we're trying to solve in the API. It looks like it will be a more involved fix than the Download All button.
", "rawMarkdown": "Thanks @srirakshith! Yes, this is a problem that we're trying to solve in the API. It looks like it will be a more involved fix than the Download All button." } ] }, { "id": 625679, "postDate": "2019-09-13T09:57:42.747Z", "content": "Currently\"Download all\"works fine for me (7 out of 85Gb are downloaded). Expected time is 3-4 hours.\nUPD: downloded in 4 hours.
Download data from kaggle gives me a 404.
", "rawMarkdown": "Download data from kaggle gives me a 404." }, { "id": 625399, "postDate": "2019-09-13T03:23:49.207Z", "content": "Also, I encounter \"429 - Too Many Requests\"
", "rawMarkdown": "Also, I encounter \"429 - Too Many Requests\"" }, { "id": 625337, "postDate": "2019-09-13T00:19:03.283Z", "content": "FYI: I was just able to download using \"Download All\". Kaggle API still gives error same as OP
", "rawMarkdown": "FYI: I was just able to download using \"Download All\". Kaggle API still gives error same as OP" }, { "id": 625273, "postDate": "2019-09-12T21:20:53.760Z", "content": "Same here\n\nDownloading visibility.json to competitions/3d-object-detection-for-\nautonomous-vehicles
\n 0%| | 0.00/408 [00:00\n100%|███████████████████████████████████████████| 408/408 [00:00<00:00, 592kB/s]\n429 - Too Many Requests\n
Also got a \"429 - Too Many Requests\"
\n\nI downloaded via the API: \"kaggle competitions download -c 3d-object-detection-for-autonomous-vehicles\"
\n\nthanks
", "votes": 4, "replies": [ { "id": 625268, "author_name": "Dr.Goldsz", "author_url": "", "post_date": "2019-09-12T21:04:04.233000", "content": "Same here
", "votes": 0, "replies": [] } ] }, { "id": 626963, "author_name": "yuval reina", "author_url": "", "post_date": "2019-09-15T07:21:47.760000", "content": "@philculliton is there any way to download the zip file using cli? using the normal cli command loads the file one by one which result in the error stated below.
", "votes": 1, "replies": [ { "id": 627085, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-15T11:38:28.737000", "content": "Thanks! I believe that's the planned change for when the API issues are fixed. I'll let everyone know when that's working, but it's a bigger change than the problems that have already been fixed.
", "votes": 0, "replies": [] }, { "id": 627330, "author_name": "yuval reina", "author_url": "", "post_date": "2019-09-15T19:32:58.583000", "content": "The problem is still alive and kicking. can't even load from \"download all\" - too many requests
", "votes": 1, "replies": [] }, { "id": 627810, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-16T12:14:05.623000", "content": "I'm sorry to hear that @yuval6967 - thanks for letting us know. I'll pass it along to the team. I think the short-term fix for this may be to wait some time until the too-many API requests aren't a problem anymore, but I'll see if there's some better solution available.
", "votes": 0, "replies": [] } ] }, { "id": 625908, "author_name": "vgoklani", "author_url": "", "post_date": "2019-09-13T15:17:54.370000", "content": "Still getting 429 errors. It's a lot of data to download, and the competition timeline is relatively short. Could you please get this resolved ASAP
", "votes": 1, "replies": [ { "id": 625920, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-13T15:30:18.647000", "content": "Thanks! We're working on it. For now, the Download All button appears to be working for most users. Please let me know if that's not the case.
", "votes": 0, "replies": [] }, { "id": 626037, "author_name": "", "author_url": "", "post_date": "2019-09-13T18:03:40.393000", "content": "", "votes": 0, "replies": [] }, { "id": 626054, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-13T18:27:37.280000", "content": "Thanks @mmregan! I'll let the team know there are still problems with Download All. This currently appears to be a fix propagation issue - please try it again in 30-60 minutes and let me know if it's still happening. We'll keep investigating / working on it!
", "votes": 0, "replies": [] } ] }, { "id": 625274, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-12T21:22:04.310000", "content": "Hi all! We're working on getting all forms of download working, but the dataset is now available via Download All.
", "votes": 1, "replies": [] }, { "id": 625173, "author_name": "RajeevRanjan", "author_url": "", "post_date": "2019-09-12T18:59:27.583000", "content": "I have tried downloading manually getting 404 page not found\nthen trying kaggle script.\nkaggle script error - 429 - Too Many Requests
", "votes": 1, "replies": [] }, { "id": 625118, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-12T18:08:18.583000", "content": "Thanks for bringing this to our attention. I'll see what can be done.
", "votes": 1, "replies": [] }, { "id": 639245, "author_name": "Adolfo Villalobos", "author_url": "", "post_date": "2019-10-03T01:00:23.523000", "content": "Just adding myself to the discussion, I'm having the same problem with de API. Can't use Download All button either.
\n\nThe solution i found was to download the data from here: https://level5.lyft.com/dataset/download-dataset/, in case anyone is still looking for a solution.
\n\nBest regards
", "votes": 0, "replies": [ { "id": 639248, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-10-03T01:23:14.897000", "content": "Hi @amvillalobos - thanks! You're still getting a 429 error with both the API and Download All button?
\n\nThe dataset hosted at the link you mentioned is only the training set, so it doesn't contain everything you need to work on the competition.
", "votes": 0, "replies": [] } ] }, { "id": 630144, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-19T19:37:26.190000", "content": "Thanks for all your feedback, everybody, it was extremely helpful! Sorry for the delay in getting this working, it was a complex issue and required some work from our excellent engineers.
\n\nThe API should work now for download competition data - you just need to update your kaggle library as described [here] (https://www.kaggle.com/c/3d-object-detection-for-autonomous-vehicles/discussion/109523#latest-630142). Let us know if you have any further problems!
I still am getting 429 error\nunable to download data.
", "votes": 0, "replies": [] }, { "id": 629426, "author_name": "Manu Correa", "author_url": "", "post_date": "2019-09-18T19:04:52.920000", "content": "I downloaded all the data without API and I have problems to extract it on Linux and Windows, it seems to be corrupted.
", "votes": 0, "replies": [ { "id": 630145, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-19T19:38:00.423000", "content": "I'm sorry to hear that! What kind of problems are you running into?
", "votes": 0, "replies": [] } ] }, { "id": 628532, "author_name": "Maksim Filipenko", "author_url": "", "post_date": "2019-09-17T13:39:47.933000", "content": "I have the same issue.
\n\n
Download All does not work - it says too many requests. \n@philculliton Could you let us know when the planned fix for API will take place?\nThanks so much
", "votes": 0, "replies": [ { "id": 627807, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-16T12:12:01.280000", "content": "Hi @narsil! The API fix will hopefully take place this week - as I understand it, it's a bigger fix than the other pieces. I'll ask about too many requests from the Download All button, but I suspect the short-term fix will be to wait some amount of time until the earlier requests are no longer a problem. (I would guess a few hours?) I'll see if there's something else that can be done.
I got a 404 error when I tried downloading via Chrome on Ubuntu. Got 429 - Too Many Requests when I tried using the Kaggle API.
", "votes": 0, "replies": [ { "id": 625924, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-13T15:31:50.930000", "content": "Thanks. I'll let our engineers know we're still seeing problems with Download All. It's likely a fix propagation issue, so in the meantime please give it another try in 30-60 minutes.
", "votes": 0, "replies": [] }, { "id": 625982, "author_name": "Srirakshith Betageri", "author_url": "", "post_date": "2019-09-13T16:46:52.130000", "content": "Thank you for the prompt response Phil. One more observation. I noticed that when downloading via the kaggle API, the files aren't in their respective folders. All the files are under the same root directory.
", "votes": 0, "replies": [] }, { "id": 626028, "author_name": "Phil Culliton", "author_url": "", "post_date": "2019-09-13T17:46:44.477000", "content": "Thanks @srirakshith! Yes, this is a problem that we're trying to solve in the API. It looks like it will be a more involved fix than the Download All button.
", "votes": 0, "replies": [] } ] }, { "id": 625679, "author_name": "Vadik", "author_url": "", "post_date": "2019-09-13T09:57:42.747000", "content": "Currently\"Download all\"works fine for me (7 out of 85Gb are downloaded). Expected time is 3-4 hours.\nUPD: downloded in 4 hours.
Download data from kaggle gives me a 404.
", "votes": 0, "replies": [] }, { "id": 625399, "author_name": "Milton Wong", "author_url": "", "post_date": "2019-09-13T03:23:49.207000", "content": "Also, I encounter \"429 - Too Many Requests\"
", "votes": 0, "replies": [] }, { "id": 625337, "author_name": "Giri Gopalan", "author_url": "", "post_date": "2019-09-13T00:19:03.283000", "content": "FYI: I was just able to download using \"Download All\". Kaggle API still gives error same as OP
", "votes": 0, "replies": [] }, { "id": 625273, "author_name": "Andrés Miguel Torrubia Sáez", "author_url": "", "post_date": "2019-09-12T21:20:53.760000", "content": "Same here\n\nDownloading visibility.json to competitions/3d-object-detection-for-\nautonomous-vehicles
\n 0%| | 0.00/408 [00:00\n100%|███████████████████████████████████████████| 408/408 [00:00<00:00, 592kB/s]\n429 - Too Many Requests\n