Hi,may be very basic question. How i can just download only Train data in Kaggle instead of oth to save on disk memory which is limited in Colab.
", "messages": [ { "id": "1242458", "postDate": "03/17/2021 16:19:38", "content": "Hi,may be very basic question. How i can just download only Train data in Kaggle instead of oth to save on disk memory which is limited in Colab.
", "rawMarkdown": "Hi,may be very basic question. How i can just download only Train data in Kaggle instead of oth to save on disk memory which is limited in Colab.", "votes": null }, { "id": "1243075", "postDate": "03/18/2021 02:10:56", "content": "I did not try before, but I think the way below may work.
\nStep 1. Create a notebook
\nStep 2. Save train data as output
\nStep 3. Create dataset with your output data
\nStep 4. Use kaggle API to download train data
Or simply with one line command, !wget \"https://storage.googleapis.com/kaggle-data-sets/1136396/2008726/compressed/train.zip?GoogleAccessId=web-data@kaggle-161607.iam.gserviceaccount.com&Expires=1616292750&Signature=obg%2F6ziPix4MjHDPt%2FwPR0uZU4Rc8PxJTaT%2BLJPCEMBDWPsgVLoXzYzYw5cuyZ24iYAlJN%2Ff7nyqQYkPm5Ov9d10IRZLv2X4V5pJYErdAiLYG5uEk3xO9%2FRgVQq8VOV1dv5tV4MEUJBiF3C%2BIdHHFwwfwARPGH1KO8S8OBG%2FNevxL3gzkotkrqo25KicVoxyByGNwwRFLveBeGXvpEq9pvOXWV7dGf9COc38EE2EAE7QG3xDyOtYQDhro7FsawQTDp3toJ244B33rIBZ5Il%2Bfywgn3a425R6BG8jJlYfnh40ACAmn7KQMtBIhr7gE0YQQPkTAHBtm45JgWm%2F%2Bhh%2F3g%3D%3D&response-content-disposition=attachment%3B+filename%3Dtrain.zip\"
Agreed. The command works but the link will update (maybe every week? I am not sure).
", "rawMarkdown": "Agreed. The command works but the link will update (maybe every week? I am not sure).", "votes": null }, { "id": "1243841", "postDate": "03/18/2021 14:23:06", "content": "isint there an option to download only folder using kaggle download competition api. ?
", "rawMarkdown": "isint there an option to download only folder using kaggle download competition api. ?", "votes": null }, { "id": "1244194", "postDate": "03/18/2021 18:57:41", "content": "Hey @jaideepvalani,
\nThis link might help you https://www.kaggle.com/general/74235. I have also run out of GPU time in Kaggle and will have to go to Colab now 👍
\nThanks,
\nOld Monk
Get GCS bucket url of the dataset. Use !gsutil cp to download.
", "rawMarkdown": "Get GCS bucket url of the dataset. Use !gsutil cp to download.", "votes": null } ], "comments": [ { "id": 1243075, "author_name": "louieshao", "author_url": "", "post_date": "03/18/2021 02:10:56", "content": "I did not try before, but I think the way below may work.
\nStep 1. Create a notebook
\nStep 2. Save train data as output
\nStep 3. Create dataset with your output data
\nStep 4. Use kaggle API to download train data
Or simply with one line command, !wget \"https://storage.googleapis.com/kaggle-data-sets/1136396/2008726/compressed/train.zip?GoogleAccessId=web-data@kaggle-161607.iam.gserviceaccount.com&Expires=1616292750&Signature=obg%2F6ziPix4MjHDPt%2FwPR0uZU4Rc8PxJTaT%2BLJPCEMBDWPsgVLoXzYzYw5cuyZ24iYAlJN%2Ff7nyqQYkPm5Ov9d10IRZLv2X4V5pJYErdAiLYG5uEk3xO9%2FRgVQq8VOV1dv5tV4MEUJBiF3C%2BIdHHFwwfwARPGH1KO8S8OBG%2FNevxL3gzkotkrqo25KicVoxyByGNwwRFLveBeGXvpEq9pvOXWV7dGf9COc38EE2EAE7QG3xDyOtYQDhro7FsawQTDp3toJ244B33rIBZ5Il%2Bfywgn3a425R6BG8jJlYfnh40ACAmn7KQMtBIhr7gE0YQQPkTAHBtm45JgWm%2F%2Bhh%2F3g%3D%3D&response-content-disposition=attachment%3B+filename%3Dtrain.zip\"
Agreed. The command works but the link will update (maybe every week? I am not sure).
", "votes": null, "replies": [] }, { "id": 1243841, "author_name": "jaideepvalani", "author_url": "", "post_date": "03/18/2021 14:23:06", "content": "isint there an option to download only folder using kaggle download competition api. ?
", "votes": null, "replies": [] } ] }, { "id": 1244194, "author_name": "saurabhbagchi", "author_url": "", "post_date": "03/18/2021 18:57:41", "content": "Hey @jaideepvalani,
\nThis link might help you https://www.kaggle.com/general/74235. I have also run out of GPU time in Kaggle and will have to go to Colab now 👍
\nThanks,
\nOld Monk
Get GCS bucket url of the dataset. Use !gsutil cp to download.
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "1242458": "Hi,may be very basic question. How i can just download only Train data in Kaggle instead of oth to save on disk memory which is limited in Colab.", "1243075": "I did not try before, but I think the way below may work.\nStep 1. Create a notebook \nStep 2. Save train data as output\nStep 3. Create dataset with your output data\nStep 4. Use kaggle API to download train data\n\nOr simply with one line command, `!wget \"https://storage.googleapis.com/kaggle-data-sets/1136396/2008726/compressed/train.zip?GoogleAccessId=web-data@kaggle-161607.iam.gserviceaccount.com&Expires=1616292750&Signature=obg%2F6ziPix4MjHDPt%2FwPR0uZU4Rc8PxJTaT%2BLJPCEMBDWPsgVLoXzYzYw5cuyZ24iYAlJN%2Ff7nyqQYkPm5Ov9d10IRZLv2X4V5pJYErdAiLYG5uEk3xO9%2FRgVQq8VOV1dv5tV4MEUJBiF3C%2BIdHHFwwfwARPGH1KO8S8OBG%2FNevxL3gzkotkrqo25KicVoxyByGNwwRFLveBeGXvpEq9pvOXWV7dGf9COc38EE2EAE7QG3xDyOtYQDhro7FsawQTDp3toJ244B33rIBZ5Il%2Bfywgn3a425R6BG8jJlYfnh40ACAmn7KQMtBIhr7gE0YQQPkTAHBtm45JgWm%2F%2Bhh%2F3g%3D%3D&response-content-disposition=attachment%3B+filename%3Dtrain.zip\"`", "1243401": "Agreed. The command works but the link will update (maybe every week? I am not sure).", "1243841": "isint there an option to download only folder using kaggle download competition api. ?", "1244194": "Hey @jaideepvalani,\n\nThis link might help you https://www.kaggle.com/general/74235. I have also run out of GPU time in Kaggle and will have to go to Colab now 👍\n\nThanks,\nOld Monk", "1244504": "Get GCS bucket url of the dataset. Use !gsutil cp to download." }, "source": "meta" }