Total dataset is very large. So, I wanted to download only jpeg folder(including with the contents inside) in google colaboratory. Using kaggle api, I can download a specific file only. I can run a loop for each files in that folder. But is there any other way, so that I can download a specific folder only with single command ?
", "messages": [ { "id": "865160", "postDate": "05/28/2020 12:40:17", "content": "Total dataset is very large. So, I wanted to download only jpeg folder(including with the contents inside) in google colaboratory. Using kaggle api, I can download a specific file only. I can run a loop for each files in that folder. But is there any other way, so that I can download a specific folder only with single command ?
", "rawMarkdown": "Total dataset is very large. So, I wanted to download only jpeg folder(including with the contents inside) in google colaboratory. Using kaggle api, I can download a specific file only. I can run a loop for each files in that folder. But is there any other way, so that I can download a specific folder only with single command ?", "votes": null }, { "id": "865277", "postDate": "05/28/2020 14:15:13", "content": "yeah i have the same question
", "rawMarkdown": "yeah i have the same question", "votes": null }, { "id": "865655", "postDate": "05/28/2020 19:20:22", "content": "Me too
", "rawMarkdown": "Me too", "votes": null }, { "id": "868097", "postDate": "05/30/2020 23:26:40", "content": "deleted
", "rawMarkdown": "deleted", "votes": null }, { "id": "887859", "postDate": "06/16/2020 00:05:43", "content": "the same problem here. the proposition by @twopift won't work because isn't going to let me download specific folders, instead it will try to load the entire 109 GB zipped into a 70 GB free-colab workspace which as you might expect will crash, I even tried to move it directly to my unlimitted storage google drive but it crashes since it has to load it first in the workspace.
", "rawMarkdown": "the same problem here. the proposition by @twopift won't work because isn't going to let me download specific folders, instead it will try to load the entire 109 GB zipped into a 70 GB free-colab workspace which as you might expect will crash, I even tried to move it directly to my unlimitted storage google drive but it crashes since it has to load it first in the workspace.", "votes": null }, { "id": "890137", "postDate": "06/17/2020 10:34:24", "content": "Yes, I see, the api only accommodates downloading individual files, not folders - that's a shame.
", "rawMarkdown": "Yes, I see, the api only accommodates downloading individual files, not folders - that's a shame.", "votes": null }, { "id": "890400", "postDate": "06/17/2020 13:44:22", "content": "Hello @amlan107 , I was having the same problem and Kaggle API wasn't solving the problem.\nThen I came around one discussion on kaggle, where this reply by @beingmiakashs helped me in solving this problem.
\n\nWith this solution, you can easily download any subfolder(Like jpeg) in the dataset.
\n\nThis is the link to full discussion: wget train files
\n\nHappy Kaggling :)
", "rawMarkdown": "Hello @amlan107 , I was having the same problem and Kaggle API wasn't solving the problem.\nThen I came around one discussion on kaggle, where [this reply](https://www.kaggle.com/c/deepfake-detection-challenge/discussion/121194#693924) by @beingmiakashs helped me in solving this problem.\n\nWith this solution, you can easily download any subfolder(Like jpeg) in the dataset.\n\nThis is the link to full discussion: [wget train files](https://www.kaggle.com/c/deepfake-detection-challenge/discussion/121194#)\n\nHappy Kaggling :)", "votes": null }, { "id": "890533", "postDate": "06/17/2020 14:51:06", "content": "I did solve the problem, download it through the browser, pause, copy download link,and wget it from colab.
", "rawMarkdown": "I did solve the problem, download it through the browser, pause, copy download link,and wget it from colab.", "votes": null }, { "id": "890753", "postDate": "06/17/2020 17:15:09", "content": "Thanks a lot @joshi98kishan , it worked !!!👌 💙
", "rawMarkdown": "Thanks a lot @joshi98kishan , it worked !!!👌 💙", "votes": null } ], "comments": [ { "id": 865277, "author_name": "harrywanght", "author_url": "", "post_date": "05/28/2020 14:15:13", "content": "yeah i have the same question
", "votes": null, "replies": [] }, { "id": 865655, "author_name": "maximofn", "author_url": "", "post_date": "05/28/2020 19:20:22", "content": "Me too
", "votes": null, "replies": [] }, { "id": 868097, "author_name": "twopift", "author_url": "", "post_date": "05/30/2020 23:26:40", "content": "deleted
", "votes": null, "replies": [] }, { "id": 887859, "author_name": "ramadankarim", "author_url": "", "post_date": "06/16/2020 00:05:43", "content": "the same problem here. the proposition by @twopift won't work because isn't going to let me download specific folders, instead it will try to load the entire 109 GB zipped into a 70 GB free-colab workspace which as you might expect will crash, I even tried to move it directly to my unlimitted storage google drive but it crashes since it has to load it first in the workspace.
", "votes": null, "replies": [ { "id": 890137, "author_name": "twopift", "author_url": "", "post_date": "06/17/2020 10:34:24", "content": "Yes, I see, the api only accommodates downloading individual files, not folders - that's a shame.
", "votes": null, "replies": [] }, { "id": 890533, "author_name": "ramadankarim", "author_url": "", "post_date": "06/17/2020 14:51:06", "content": "I did solve the problem, download it through the browser, pause, copy download link,and wget it from colab.
", "votes": null, "replies": [] } ] }, { "id": 890400, "author_name": "joshi98kishan", "author_url": "", "post_date": "06/17/2020 13:44:22", "content": "Hello @amlan107 , I was having the same problem and Kaggle API wasn't solving the problem.\nThen I came around one discussion on kaggle, where this reply by @beingmiakashs helped me in solving this problem.
\n\nWith this solution, you can easily download any subfolder(Like jpeg) in the dataset.
\n\nThis is the link to full discussion: wget train files
\n\nHappy Kaggling :)
", "votes": null, "replies": [ { "id": 890753, "author_name": "amlan107", "author_url": "", "post_date": "06/17/2020 17:15:09", "content": "Thanks a lot @joshi98kishan , it worked !!!👌 💙
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "865160": "Total dataset is very large. So, I wanted to download only jpeg folder(including with the contents inside) in google colaboratory. Using kaggle api, I can download a specific file only. I can run a loop for each files in that folder. But is there any other way, so that I can download a specific folder only with single command ?", "865277": "yeah i have the same question", "865655": "Me too", "868097": "deleted", "887859": "the same problem here. the proposition by @twopift won't work because isn't going to let me download specific folders, instead it will try to load the entire 109 GB zipped into a 70 GB free-colab workspace which as you might expect will crash, I even tried to move it directly to my unlimitted storage google drive but it crashes since it has to load it first in the workspace.", "890137": "Yes, I see, the api only accommodates downloading individual files, not folders - that's a shame.", "890400": "Hello @amlan107 , I was having the same problem and Kaggle API wasn't solving the problem.\nThen I came around one discussion on kaggle, where [this reply](https://www.kaggle.com/c/deepfake-detection-challenge/discussion/121194#693924) by @beingmiakashs helped me in solving this problem.\n\nWith this solution, you can easily download any subfolder(Like jpeg) in the dataset.\n\nThis is the link to full discussion: [wget train files](https://www.kaggle.com/c/deepfake-detection-challenge/discussion/121194#)\n\nHappy Kaggling :)", "890533": "I did solve the problem, download it through the browser, pause, copy download link,and wget it from colab.", "890753": "Thanks a lot @joshi98kishan , it worked !!!👌 💙" }, "source": "meta" }