{
  "id": 300601,
  "title": "copy kaggle dataset to google drive",
  "url": "/competitions/tensorflow-great-barrier-reef/discussion/300601",
  "author_name": "dragon zhang",
  "post_date": "2022-01-13T10:10:13.934000",
  "votes": 9,
  "comment_count": 4,
  "views": 0,
  "content": "<p>the API for download works.</p>\n<p>but here is my 2cents:<br>\ngot gs address from kaggle, and then use gscfs to copy:</p>\n<p>!pip -q install fsspec<br>\n!pip -q  install gcsfs<br>\nimport gcsfs<br>\nfs = gcsfs.GCSFileSystem()</p>\n<p>!gsutil -m cp -r  gs://dataset_address/  /content/mydrive/kaggle/</p>",
  "messages": [
    {
      "id": 1648291,
      "postDate": "2022-01-13T10:10:13.933Z",
      "content": "<p>the API for download works.</p>\n<p>but here is my 2cents:<br>\ngot gs address from kaggle, and then use gscfs to copy:</p>\n<p>!pip -q install fsspec<br>\n!pip -q  install gcsfs<br>\nimport gcsfs<br>\nfs = gcsfs.GCSFileSystem()</p>\n<p>!gsutil -m cp -r  gs://dataset_address/  /content/mydrive/kaggle/</p>",
      "rawMarkdown": "the API for download works.\n\nbut here is my 2cents:\ngot gs address from kaggle, and then use gscfs to copy:\n\n!pip -q install fsspec\n!pip -q  install gcsfs\nimport gcsfs\nfs = gcsfs.GCSFileSystem()\n\n!gsutil -m cp -r  gs://dataset_address/  /content/mydrive/kaggle/",
      "votes": 9
    },
    {
      "id": 1649527,
      "postDate": "2022-01-14T11:04:46.220Z",
      "content": "<p>How much time it takes to copy the complete dataset ? <a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a> </p>",
      "rawMarkdown": "How much time it takes to copy the complete dataset ? @dragonzhang ",
      "replies": [
        {
          "id": 1649742,
          "postDate": "2022-01-14T14:55:50.200Z",
          "content": "<p>It is faster than downloading, depends on dataset size.</p>",
          "rawMarkdown": "It is faster than downloading, depends on dataset size.",
          "votes": 1
        },
        {
          "id": 1649755,
          "postDate": "2022-01-14T15:03:01.467Z",
          "content": "<p>OK <a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a>. Thanks for sharing.</p>",
          "rawMarkdown": "OK @dragonzhang. Thanks for sharing."
        }
      ]
    },
    {
      "id": 1650090,
      "postDate": "2022-01-14T19:53:03.957Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1649527,
      "author_name": "Kartik Khandelwal",
      "author_url": "",
      "post_date": "2022-01-14T11:04:46.220000",
      "content": "<p>How much time it takes to copy the complete dataset ? <a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a> </p>",
      "votes": 0,
      "replies": [
        {
          "id": 1649742,
          "author_name": "dragon zhang",
          "author_url": "",
          "post_date": "2022-01-14T14:55:50.200000",
          "content": "<p>It is faster than downloading, depends on dataset size.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1649755,
          "author_name": "Kartik Khandelwal",
          "author_url": "",
          "post_date": "2022-01-14T15:03:01.467000",
          "content": "<p>OK <a href=\"https://www.kaggle.com/dragonzhang\" target=\"_blank\">@dragonzhang</a>. Thanks for sharing.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1650090,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-01-14T19:53:03.957000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1648291": "the API for download works.\n\nbut here is my 2cents:\ngot gs address from kaggle, and then use gscfs to copy:\n\n!pip -q install fsspec\n!pip -q  install gcsfs\nimport gcsfs\nfs = gcsfs.GCSFileSystem()\n\n!gsutil -m cp -r  gs://dataset_address/  /content/mydrive/kaggle/",
    "1649527": "How much time it takes to copy the complete dataset ? @dragonzhang ",
    "1650090": ""
  }
}