{
  "id": 151631,
  "title": "Error using KaggleDatasets().get_gcs_path()",
  "url": "/competitions/alaska2-image-steganalysis/discussion/151631",
  "author_name": "haveri",
  "post_date": "2020-05-16T09:47:35.338000",
  "votes": 7,
  "comment_count": 15,
  "views": 0,
  "content": "<p>Need help from someone in Kaggle team. I get the error as shown in the image below. This happens only for this competition. The same code works for other competition. Do I need to do something different if I need to access competition data as a GCS. This would have enabled using a TPU to train models.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2F4411f55455e523ef5587e04546813b99%2FKaggleDatasetConnectionError.png?generation=1589622346550822&amp;alt=media\" alt=\"\"></p>\n\n<p>EDIT: As recommended below by <a href=\"/davelo12\">@davelo12</a> you can use an alternative i.e. assigning the path with the string 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'. This should work as long as this path does not change. But advise using the API as a first choice if it works.</p>",
  "messages": [
    {
      "id": 850064,
      "postDate": "2020-05-16T09:47:35.340Z",
      "content": "<p>Need help from someone in Kaggle team. I get the error as shown in the image below. This happens only for this competition. The same code works for other competition. Do I need to do something different if I need to access competition data as a GCS. This would have enabled using a TPU to train models.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2F4411f55455e523ef5587e04546813b99%2FKaggleDatasetConnectionError.png?generation=1589622346550822&amp;alt=media\" alt=\"\"></p>\n\n<p>EDIT: As recommended below by <a href=\"/davelo12\">@davelo12</a> you can use an alternative i.e. assigning the path with the string 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'. This should work as long as this path does not change. But advise using the API as a first choice if it works.</p>",
      "rawMarkdown": "Need help from someone in Kaggle team. I get the error as shown in the image below. This happens only for this competition. The same code works for other competition. Do I need to do something different if I need to access competition data as a GCS. This would have enabled using a TPU to train models.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2F4411f55455e523ef5587e04546813b99%2FKaggleDatasetConnectionError.png?generation=1589622346550822&amp;alt=media)\n\nEDIT: As recommended below by @davelo12 you can use an alternative i.e. assigning the path with the string 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'. This should work as long as this path does not change. But advise using the API as a first choice if it works.",
      "votes": 7
    },
    {
      "id": 851525,
      "postDate": "2020-05-17T17:29:18.653Z",
      "content": "<p>I experienced this same error about 50% of the times I ran my notebook over the last 24 hours but haven't experienced this error previously. One solution is to adjust your notebook to hard code the link to these data, like this:</p>\n\n<p>GCS_DS_PATH = 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'</p>",
      "rawMarkdown": "I experienced this same error about 50% of the times I ran my notebook over the last 24 hours but haven't experienced this error previously. One solution is to adjust your notebook to hard code the link to these data, like this:\n\nGCS_DS_PATH = 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'",
      "votes": 4,
      "replies": [
        {
          "id": 851541,
          "postDate": "2020-05-17T17:41:33.503Z",
          "content": "<p>Thank you. I will definitely give this a try.</p>",
          "rawMarkdown": "Thank you. I will definitely give this a try.",
          "votes": 2
        },
        {
          "id": 851841,
          "postDate": "2020-05-18T00:47:42.193Z",
          "content": "<p>Wow thank you. I solved the problem with your method ！</p>",
          "rawMarkdown": "Wow thank you. I solved the problem with your method ！",
          "votes": 1
        }
      ]
    },
    {
      "id": 850238,
      "postDate": "2020-05-16T12:55:13.793Z",
      "content": "<p>Adding one more screenshot. There are other datasets that loads but not alaska2-image-steganalysis.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2Fd9af42b83eb471c111155aeb3228d52e%2FKaggleDatasetConnectionError-2.png?generation=1589633690595260&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Adding one more screenshot. There are other datasets that loads but not alaska2-image-steganalysis.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2Fd9af42b83eb471c111155aeb3228d52e%2FKaggleDatasetConnectionError-2.png?generation=1589633690595260&amp;alt=media)\n",
      "votes": 1
    },
    {
      "id": 850192,
      "postDate": "2020-05-16T12:06:37.953Z",
      "content": "<p>I had this error too. I just turned off the internet of the kernel and the I turned on again.\nTo turn off the internet you have to go to settings. There is a slider where you can turn the internet on and off.\nI hope this helps😄 </p>",
      "rawMarkdown": "I had this error too. I just turned off the internet of the kernel and the I turned on again.\nTo turn off the internet you have to go to settings. There is a slider where you can turn the internet on and off.\nI hope this helps😄 ",
      "votes": 1,
      "replies": [
        {
          "id": 850237,
          "postDate": "2020-05-16T12:52:20.570Z",
          "content": "<p>Thanks <a href=\"/derinformatiker\">@derinformatiker</a> I tried what you recommended. But unfortunately it did not help.\nI turned it off and turned it back on. Tried. It failed.\nI turned it off. Shut down the interactive kernel. Restarted and turned back the internet on. Again failed.\nI added other competition datasets and loaded it using KaggleDatasets. They were successful. But the Alaska2 dataset failed loading. Looks like some problem very specifically with this dataset. Hope some one from Kaggle team also notices this message and looks in to it.</p>\n\n<p>Thanks again <a href=\"/derinformatiker\">@derinformatiker</a> </p>",
          "rawMarkdown": "Thanks @derinformatiker I tried what you recommended. But unfortunately it did not help.\nI turned it off and turned it back on. Tried. It failed.\nI turned it off. Shut down the interactive kernel. Restarted and turned back the internet on. Again failed.\nI added other competition datasets and loaded it using KaggleDatasets. They were successful. But the Alaska2 dataset failed loading. Looks like some problem very specifically with this dataset. Hope some one from Kaggle team also notices this message and looks in to it.\n\nThanks again @derinformatiker ",
          "votes": 2
        }
      ]
    },
    {
      "id": 857090,
      "postDate": "2020-05-22T09:42:37.483Z",
      "content": "<p>Don't know what is happening with this issue. But either someone has quietly fixed the issue or someone has changed something. The old path no longer works. And the new path seems to be</p>\n\n<p>gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226</p>",
      "rawMarkdown": "Don't know what is happening with this issue. But either someone has quietly fixed the issue or someone has changed something. The old path no longer works. And the new path seems to be\n\ngs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226",
      "votes": 2
    },
    {
      "id": 850319,
      "postDate": "2020-05-16T14:15:31.043Z",
      "content": "<p>If you have more than one data source then you have to specify  which one you want to use</p>",
      "rawMarkdown": "If you have more than one data source then you have to specify  which one you want to use",
      "votes": 2,
      "replies": [
        {
          "id": 850350,
          "postDate": "2020-05-16T14:45:52.607Z",
          "content": "<p>Thanks. You are right. But I am already doing that if you see the second image attached. It still does not seem to work. I have seen many of the competitors using the GCS for this competition. So I am surprised but clueless.</p>",
          "rawMarkdown": "Thanks. You are right. But I am already doing that if you see the second image attached. It still does not seem to work. I have seen many of the competitors using the GCS for this competition. So I am surprised but clueless.",
          "votes": 1
        },
        {
          "id": 858817,
          "postDate": "2020-05-23T20:36:54.637Z",
          "content": "<p>MY_GCS_PATH=KaggleDatasets().get_gcs_path('my-kaggle-dataset')\nfor correct name of 'my-kaggle-dataset' check with  !ls /kaggle/input    command  </p>",
          "rawMarkdown": "MY_GCS_PATH=KaggleDatasets().get_gcs_path('my-kaggle-dataset')\nfor correct name of 'my-kaggle-dataset' check with  !ls /kaggle/input    command  "
        }
      ]
    },
    {
      "id": 870704,
      "postDate": "2020-06-01T20:40:51.197Z",
      "content": "<p>Just trying all of this stuff (in input path use 2 files and tried MYGCSPATH=KaggleDatasets().getgcspath('my-kaggle-dataset'), but it didn't work) , but nothing work:\n1) trun internet on/off don't work\n2) use path gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226 and old path gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a also don't work</p>\n\n<p>example error above train code</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2827699%2F2f133ecc8eca3389814a5dff948b1bec%2Ferr.png?generation=1591043955754417&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Just trying all of this stuff (in input path use 2 files and tried MYGCSPATH=KaggleDatasets().getgcspath('my-kaggle-dataset'), but it didn't work) , but nothing work:\n1) trun internet on/off don't work\n2) use path gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226 and old path gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a also don't work\n\nexample error above train code\n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2827699%2F2f133ecc8eca3389814a5dff948b1bec%2Ferr.png?generation=1591043955754417&amp;alt=media)\n",
      "replies": [
        {
          "id": 871042,
          "postDate": "2020-06-02T05:33:58.013Z",
          "content": "<p>The ideal way to select the path is indeed using the KaggleDataset API. But unfortunately its not working well. And the path keeps changing. Try using</p>\n\n<p>gs://kds-069304ce8206851f8e9bfff4331287120fd72deaecd916c0c542ad4d</p>",
          "rawMarkdown": "The ideal way to select the path is indeed using the KaggleDataset API. But unfortunately its not working well. And the path keeps changing. Try using\n\ngs://kds-069304ce8206851f8e9bfff4331287120fd72deaecd916c0c542ad4d"
        }
      ]
    },
    {
      "id": 850972,
      "postDate": "2020-05-17T08:06:38.053Z",
      "content": "<p>I created a notebook to demonstrate this error so Kaggle infrastructure folks can have a look at it. <a href=\"https://www.kaggle.com/haveri/error-using-kaggledatasets-get-gcs-path\">It is available here.</a></p>",
      "rawMarkdown": "I created a notebook to demonstrate this error so Kaggle infrastructure folks can have a look at it. [It is available here.](https://www.kaggle.com/haveri/error-using-kaggledatasets-get-gcs-path)",
      "replies": [
        {
          "id": 870714,
          "postDate": "2020-06-01T20:52:49.670Z",
          "content": "<p>I have also absorb this error I guess this is due to large data\ntry run it again sometime  and it worked</p>",
          "rawMarkdown": "I have also absorb this error I guess this is due to large data\ntry run it again sometime  and it worked"
        }
      ]
    },
    {
      "id": 850187,
      "postDate": "2020-05-16T12:03:12.977Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 851525,
      "author_name": "Dave Lorenz",
      "author_url": "",
      "post_date": "2020-05-17T17:29:18.653000",
      "content": "<p>I experienced this same error about 50% of the times I ran my notebook over the last 24 hours but haven't experienced this error previously. One solution is to adjust your notebook to hard code the link to these data, like this:</p>\n\n<p>GCS_DS_PATH = 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'</p>",
      "votes": 4,
      "replies": [
        {
          "id": 851541,
          "author_name": "haveri",
          "author_url": "",
          "post_date": "2020-05-17T17:41:33.503000",
          "content": "<p>Thank you. I will definitely give this a try.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 851841,
          "author_name": "wyyyywwy",
          "author_url": "",
          "post_date": "2020-05-18T00:47:42.193000",
          "content": "<p>Wow thank you. I solved the problem with your method ！</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 850238,
      "author_name": "haveri",
      "author_url": "",
      "post_date": "2020-05-16T12:55:13.793000",
      "content": "<p>Adding one more screenshot. There are other datasets that loads but not alaska2-image-steganalysis.</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2Fd9af42b83eb471c111155aeb3228d52e%2FKaggleDatasetConnectionError-2.png?generation=1589633690595260&amp;alt=media\" alt=\"\"></p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 850192,
      "author_name": "Der Informatiker",
      "author_url": "",
      "post_date": "2020-05-16T12:06:37.953000",
      "content": "<p>I had this error too. I just turned off the internet of the kernel and the I turned on again.\nTo turn off the internet you have to go to settings. There is a slider where you can turn the internet on and off.\nI hope this helps😄 </p>",
      "votes": 1,
      "replies": [
        {
          "id": 850237,
          "author_name": "haveri",
          "author_url": "",
          "post_date": "2020-05-16T12:52:20.570000",
          "content": "<p>Thanks <a href=\"/derinformatiker\">@derinformatiker</a> I tried what you recommended. But unfortunately it did not help.\nI turned it off and turned it back on. Tried. It failed.\nI turned it off. Shut down the interactive kernel. Restarted and turned back the internet on. Again failed.\nI added other competition datasets and loaded it using KaggleDatasets. They were successful. But the Alaska2 dataset failed loading. Looks like some problem very specifically with this dataset. Hope some one from Kaggle team also notices this message and looks in to it.</p>\n\n<p>Thanks again <a href=\"/derinformatiker\">@derinformatiker</a> </p>",
          "votes": 2,
          "replies": []
        }
      ]
    },
    {
      "id": 857090,
      "author_name": "haveri",
      "author_url": "",
      "post_date": "2020-05-22T09:42:37.483000",
      "content": "<p>Don't know what is happening with this issue. But either someone has quietly fixed the issue or someone has changed something. The old path no longer works. And the new path seems to be</p>\n\n<p>gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 850319,
      "author_name": "Ankit Maurya",
      "author_url": "",
      "post_date": "2020-05-16T14:15:31.043000",
      "content": "<p>If you have more than one data source then you have to specify  which one you want to use</p>",
      "votes": 2,
      "replies": [
        {
          "id": 850350,
          "author_name": "haveri",
          "author_url": "",
          "post_date": "2020-05-16T14:45:52.607000",
          "content": "<p>Thanks. You are right. But I am already doing that if you see the second image attached. It still does not seem to work. I have seen many of the competitors using the GCS for this competition. So I am surprised but clueless.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 858817,
          "author_name": "Ankit Maurya",
          "author_url": "",
          "post_date": "2020-05-23T20:36:54.637000",
          "content": "<p>MY_GCS_PATH=KaggleDatasets().get_gcs_path('my-kaggle-dataset')\nfor correct name of 'my-kaggle-dataset' check with  !ls /kaggle/input    command  </p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 870704,
      "author_name": "Lolik",
      "author_url": "",
      "post_date": "2020-06-01T20:40:51.197000",
      "content": "<p>Just trying all of this stuff (in input path use 2 files and tried MYGCSPATH=KaggleDatasets().getgcspath('my-kaggle-dataset'), but it didn't work) , but nothing work:\n1) trun internet on/off don't work\n2) use path gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226 and old path gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a also don't work</p>\n\n<p>example error above train code</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2827699%2F2f133ecc8eca3389814a5dff948b1bec%2Ferr.png?generation=1591043955754417&amp;alt=media\" alt=\"\"></p>",
      "votes": 0,
      "replies": [
        {
          "id": 871042,
          "author_name": "haveri",
          "author_url": "",
          "post_date": "2020-06-02T05:33:58.013000",
          "content": "<p>The ideal way to select the path is indeed using the KaggleDataset API. But unfortunately its not working well. And the path keeps changing. Try using</p>\n\n<p>gs://kds-069304ce8206851f8e9bfff4331287120fd72deaecd916c0c542ad4d</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 850972,
      "author_name": "haveri",
      "author_url": "",
      "post_date": "2020-05-17T08:06:38.053000",
      "content": "<p>I created a notebook to demonstrate this error so Kaggle infrastructure folks can have a look at it. <a href=\"https://www.kaggle.com/haveri/error-using-kaggledatasets-get-gcs-path\">It is available here.</a></p>",
      "votes": 0,
      "replies": [
        {
          "id": 870714,
          "author_name": "Ankit Maurya",
          "author_url": "",
          "post_date": "2020-06-01T20:52:49.670000",
          "content": "<p>I have also absorb this error I guess this is due to large data\ntry run it again sometime  and it worked</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 850187,
      "author_name": "",
      "author_url": "",
      "post_date": "2020-05-16T12:03:12.977000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "850064": "Need help from someone in Kaggle team. I get the error as shown in the image below. This happens only for this competition. The same code works for other competition. Do I need to do something different if I need to access competition data as a GCS. This would have enabled using a TPU to train models.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2F4411f55455e523ef5587e04546813b99%2FKaggleDatasetConnectionError.png?generation=1589622346550822&amp;alt=media)\n\nEDIT: As recommended below by @davelo12 you can use an alternative i.e. assigning the path with the string 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'. This should work as long as this path does not change. But advise using the API as a first choice if it works.",
    "851525": "I experienced this same error about 50% of the times I ran my notebook over the last 24 hours but haven't experienced this error previously. One solution is to adjust your notebook to hard code the link to these data, like this:\n\nGCS_DS_PATH = 'gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a'",
    "850238": "Adding one more screenshot. There are other datasets that loads but not alaska2-image-steganalysis.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F3768255%2Fd9af42b83eb471c111155aeb3228d52e%2FKaggleDatasetConnectionError-2.png?generation=1589633690595260&amp;alt=media)\n",
    "850192": "I had this error too. I just turned off the internet of the kernel and the I turned on again.\nTo turn off the internet you have to go to settings. There is a slider where you can turn the internet on and off.\nI hope this helps😄 ",
    "857090": "Don't know what is happening with this issue. But either someone has quietly fixed the issue or someone has changed something. The old path no longer works. And the new path seems to be\n\ngs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226",
    "850319": "If you have more than one data source then you have to specify  which one you want to use",
    "870704": "Just trying all of this stuff (in input path use 2 files and tried MYGCSPATH=KaggleDatasets().getgcspath('my-kaggle-dataset'), but it didn't work) , but nothing work:\n1) trun internet on/off don't work\n2) use path gs://kds-3160e80250280b8f39662d225fade981e32f612594b89591b34a5226 and old path gs://kds-1755c1ceceda099e2d72cdfaad9472227b90b142fe6e39e8ec12884a also don't work\n\nexample error above train code\n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F2827699%2F2f133ecc8eca3389814a5dff948b1bec%2Ferr.png?generation=1591043955754417&amp;alt=media)\n",
    "850972": "I created a notebook to demonstrate this error so Kaggle infrastructure folks can have a look at it. [It is available here.](https://www.kaggle.com/haveri/error-using-kaggledatasets-get-gcs-path)",
    "850187": ""
  }
}