{
  "id": 121420,
  "title": "Total dataset size after extraction?",
  "url": "/competitions/deepfake-detection-challenge/discussion/121420",
  "author_name": "",
  "post_date": "2019-12-13T07:28:40.913029Z",
  "votes": 2,
  "comment_count": 3,
  "views": 0,
  "content": "<p>The data page says: </p>\n\n<blockquote>\n  <p>The full training set is just over 470 GB. We've made it available as one giant file, as well as 50 smaller files, each ~10 GB in size.</p>\n</blockquote>\n\n<p>All these files are in zipped format, Can anyone tell me what's the total disk space the whole dataset is going to take after zip extraction?</p>",
  "messages": [
    {
      "id": "694104",
      "postDate": "12/13/2019 07:28:40",
      "content": "<p>The data page says: </p>\n\n<blockquote>\n  <p>The full training set is just over 470 GB. We've made it available as one giant file, as well as 50 smaller files, each ~10 GB in size.</p>\n</blockquote>\n\n<p>All these files are in zipped format, Can anyone tell me what's the total disk space the whole dataset is going to take after zip extraction?</p>",
      "rawMarkdown": "The data page says: \n\n&gt; The full training set is just over 470 GB. We've made it available as one giant file, as well as 50 smaller files, each ~10 GB in size.\n\nAll these files are in zipped format, Can anyone tell me what's the total disk space the whole dataset is going to take after zip extraction?",
      "votes": null
    },
    {
      "id": "694227",
      "postDate": "12/13/2019 10:13:19",
      "content": "<p>Not certain but it seems like the zip files are losslessly compressed. The unzipped size of the first part is only megabytes larger than the zipped file.</p>",
      "rawMarkdown": "Not certain but it seems like the zip files are losslessly compressed. The unzipped size of the first part is only megabytes larger than the zipped file.",
      "votes": null
    },
    {
      "id": "694230",
      "postDate": "12/13/2019 10:21:41",
      "content": "<p>Doesn't seem to be measurably bigger. </p>",
      "rawMarkdown": "Doesn't seem to be measurably bigger.",
      "votes": null
    },
    {
      "id": "694277",
      "postDate": "12/13/2019 11:33:36",
      "content": "<p>It's roughly 475 GB. It's not really possible to compress mp4 files using zip, so the unzipped size is pretty much the same as the zipped size.</p>",
      "rawMarkdown": "It's roughly 475 GB. It's not really possible to compress mp4 files using zip, so the unzipped size is pretty much the same as the zipped size.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 694227,
      "author_name": "matthewmasters",
      "author_url": "",
      "post_date": "12/13/2019 10:13:19",
      "content": "<p>Not certain but it seems like the zip files are losslessly compressed. The unzipped size of the first part is only megabytes larger than the zipped file.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 694230,
      "author_name": "ryches",
      "author_url": "",
      "post_date": "12/13/2019 10:21:41",
      "content": "<p>Doesn't seem to be measurably bigger. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 694277,
      "author_name": "humananalog",
      "author_url": "",
      "post_date": "12/13/2019 11:33:36",
      "content": "<p>It's roughly 475 GB. It's not really possible to compress mp4 files using zip, so the unzipped size is pretty much the same as the zipped size.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "694104": "The data page says: \n\n&gt; The full training set is just over 470 GB. We've made it available as one giant file, as well as 50 smaller files, each ~10 GB in size.\n\nAll these files are in zipped format, Can anyone tell me what's the total disk space the whole dataset is going to take after zip extraction?",
    "694227": "Not certain but it seems like the zip files are losslessly compressed. The unzipped size of the first part is only megabytes larger than the zipped file.",
    "694230": "Doesn't seem to be measurably bigger.",
    "694277": "It's roughly 475 GB. It's not really possible to compress mp4 files using zip, so the unzipped size is pretty much the same as the zipped size."
  },
  "source": "meta"
}