{
  "id": 71420,
  "title": "Corrupt .zip archive?",
  "url": "/competitions/PLAsTiCC-2018/discussion/71420",
  "author_name": "Dennis Alp",
  "post_date": "2018-11-13T14:23:53.596000",
  "votes": 0,
  "comment_count": 5,
  "views": 0,
  "content": "<p>I just tried to download the data and I am not sure if I am missing something obvious, but I find that test_set.csv.zip is corrupt.</p>\n\n<p>The file is recognized as a .zip file:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; file test_set.csv.zip \ntest_set.csv.zip: Zip archive data, at least v2.0 to extract\n</code></pre>\n\n<p>but is corrupt:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; zip -T test_set.csv.zip \nwarning [test_set.csv.zip]:  2994079001 extra bytes at beginning or within zipfile\n(attempting to process anyway)\nerror [test_set.csv.zip]:  start of central directory not found;\nzipfile corrupt.\n(please check that you have transferred or created the zipfile in the\nappropriate BINARY mode and that you have compiled UnZip properly)\ntest of test_set.csv.zip FAILED\n\nzip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n</code></pre>\n\n<p>and when trying uncompress:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; tar -xvf test_set.csv.zip \nx test_set.csv: ZIP compressed data is wrong size\ntar: Bad ZIP file\ntar: Error exit delayed from previous errors.\n</code></pre>\n\n<p>Any ideas as to what the problem could be? I have the same problem by directly downloading using the graphical interface and using the API.</p>\n\n<p>The number is supposed to be 453,653,104 lines, I find</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt;wc -l test_set.csv\n453652525 test_set.csv\n</code></pre>\n\n<p>and</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt;tail -n 2 test_set.csv\n104853653,60072.9654,5,25.621115,24.916080,0\n104853653,60077.9871,1,4.45339\n</code></pre>",
  "messages": [
    {
      "id": 420579,
      "postDate": "2018-11-13T20:57:02.900Z",
      "content": "<p>Solved. From: <a href=\"https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file\">https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file</a></p>\n\n<p>originally from <a href=\"https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/\">https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/</a></p>\n\n<p>'\"unzip\" on MAC OSX which cannot handle things zipped with PKZIP.\nI was able to brew install p7zip and unzip using the command 7za x some_file.zip'</p>\n\n<p>unzip doesn't work for me</p>\n\n<pre><code>&gt;unzip all.zip \nArchive:  all.zip\nwarning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n  (attempting to process anyway)\nerror [all.zip]:  start of central directory not found;\n  zipfile corrupt.\n  (please check that you have transferred or created the zipfile in the\n  appropriate BINARY mode and that you have compiled UnZip properly)\n</code></pre>",
      "rawMarkdown": "Solved. From: https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file\n\noriginally from https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/\n\n'\"unzip\" on MAC OSX which cannot handle things zipped with PKZIP.\nI was able to brew install p7zip and unzip using the command 7za x some_file.zip'\n\nunzip doesn't work for me\n\n    &gt;unzip all.zip \n    Archive:  all.zip\n    warning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n      (attempting to process anyway)\n    error [all.zip]:  start of central directory not found;\n      zipfile corrupt.\n      (please check that you have transferred or created the zipfile in the\n      appropriate BINARY mode and that you have compiled UnZip properly)",
      "votes": 1
    },
    {
      "id": 420380,
      "postDate": "2018-11-13T14:23:53.597Z",
      "content": "<p>I just tried to download the data and I am not sure if I am missing something obvious, but I find that test_set.csv.zip is corrupt.</p>\n\n<p>The file is recognized as a .zip file:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; file test_set.csv.zip \ntest_set.csv.zip: Zip archive data, at least v2.0 to extract\n</code></pre>\n\n<p>but is corrupt:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; zip -T test_set.csv.zip \nwarning [test_set.csv.zip]:  2994079001 extra bytes at beginning or within zipfile\n(attempting to process anyway)\nerror [test_set.csv.zip]:  start of central directory not found;\nzipfile corrupt.\n(please check that you have transferred or created the zipfile in the\nappropriate BINARY mode and that you have compiled UnZip properly)\ntest of test_set.csv.zip FAILED\n\nzip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n</code></pre>\n\n<p>and when trying uncompress:</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt; tar -xvf test_set.csv.zip \nx test_set.csv: ZIP compressed data is wrong size\ntar: Bad ZIP file\ntar: Error exit delayed from previous errors.\n</code></pre>\n\n<p>Any ideas as to what the problem could be? I have the same problem by directly downloading using the graphical interface and using the API.</p>\n\n<p>The number is supposed to be 453,653,104 lines, I find</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt;wc -l test_set.csv\n453652525 test_set.csv\n</code></pre>\n\n<p>and</p>\n\n<pre><code>&amp;gt;&amp;gt;&amp;gt;tail -n 2 test_set.csv\n104853653,60072.9654,5,25.621115,24.916080,0\n104853653,60077.9871,1,4.45339\n</code></pre>",
      "rawMarkdown": "I just tried to download the data and I am not sure if I am missing something obvious, but I find that test_set.csv.zip is corrupt.\n\nThe file is recognized as a .zip file:\n\n    &gt;&gt;&gt; file test_set.csv.zip \n    test_set.csv.zip: Zip archive data, at least v2.0 to extract\n\nbut is corrupt:\n\n    &gt;&gt;&gt; zip -T test_set.csv.zip \n    warning [test_set.csv.zip]:  2994079001 extra bytes at beginning or within zipfile\n    (attempting to process anyway)\n    error [test_set.csv.zip]:  start of central directory not found;\n    zipfile corrupt.\n    (please check that you have transferred or created the zipfile in the\n    appropriate BINARY mode and that you have compiled UnZip properly)\n    test of test_set.csv.zip FAILED\n\n    zip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n\nand when trying uncompress:\n\n    &gt;&gt;&gt; tar -xvf test_set.csv.zip \n    x test_set.csv: ZIP compressed data is wrong size\n    tar: Bad ZIP file\n    tar: Error exit delayed from previous errors.\n\nAny ideas as to what the problem could be? I have the same problem by directly downloading using the graphical interface and using the API.\n\nThe number is supposed to be 453,653,104 lines, I find\n\n    &gt;&gt;&gt;wc -l test_set.csv\n    453652525 test_set.csv\n\nand\n\n    &gt;&gt;&gt;tail -n 2 test_set.csv\n    104853653,60072.9654,5,25.621115,24.916080,0\n    104853653,60077.9871,1,4.45339"
    },
    {
      "id": 420488,
      "postDate": "2018-11-13T17:49:00.190Z",
      "content": "<p>I wasn't able to replicate the problem. <code>unzip all.zip</code> works fine for me.</p>",
      "rawMarkdown": "I wasn't able to replicate the problem. `unzip all.zip` works fine for me."
    },
    {
      "id": 420417,
      "postDate": "2018-11-13T15:41:28.453Z",
      "content": "<p>Doesn't work either, essentially the same problem</p>\n\n<pre><code>&gt;file all.zip \nall.zip: Zip archive data, at least v2.0 to extract\n&gt;zip -T all.zip \nwarning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n (attempting to process anyway)\nerror [all.zip]:  start of central directory not found;\n  zipfile corrupt.\n  (please check that you have transferred or created the zipfile in the\n  appropriate BINARY mode and that you have compiled UnZip properly)\ntest of all.zip FAILED\n\nzip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n&gt;tar -xvf all.zip \nx test_set.csv: ZIP compressed data is wrong size\ntar: Bad ZIP file\ntar: Error exit delayed from previous errors.\n</code></pre>",
      "rawMarkdown": "Doesn't work either, essentially the same problem\n\n    &gt;file all.zip \n    all.zip: Zip archive data, at least v2.0 to extract\n    &gt;zip -T all.zip \n    warning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n     (attempting to process anyway)\n    error [all.zip]:  start of central directory not found;\n      zipfile corrupt.\n      (please check that you have transferred or created the zipfile in the\n      appropriate BINARY mode and that you have compiled UnZip properly)\n    test of all.zip FAILED\n\n    zip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n    &gt;tar -xvf all.zip \n    x test_set.csv: ZIP compressed data is wrong size\n    tar: Bad ZIP file\n    tar: Error exit delayed from previous errors."
    },
    {
      "id": 420405,
      "postDate": "2018-11-13T15:30:15.637Z",
      "content": "<p>Try downloading all. It worked for me.</p>",
      "rawMarkdown": "Try downloading all. It worked for me."
    },
    {
      "id": 420385,
      "postDate": "2018-11-13T14:43:35.177Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 420579,
      "author_name": "Dennis Alp",
      "author_url": "",
      "post_date": "2018-11-13T20:57:02.900000",
      "content": "<p>Solved. From: <a href=\"https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file\">https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file</a></p>\n\n<p>originally from <a href=\"https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/\">https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/</a></p>\n\n<p>'\"unzip\" on MAC OSX which cannot handle things zipped with PKZIP.\nI was able to brew install p7zip and unzip using the command 7za x some_file.zip'</p>\n\n<p>unzip doesn't work for me</p>\n\n<pre><code>&gt;unzip all.zip \nArchive:  all.zip\nwarning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n  (attempting to process anyway)\nerror [all.zip]:  start of central directory not found;\n  zipfile corrupt.\n  (please check that you have transferred or created the zipfile in the\n  appropriate BINARY mode and that you have compiled UnZip properly)\n</code></pre>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 420488,
      "author_name": "Sohier Dane",
      "author_url": "",
      "post_date": "2018-11-13T17:49:00.190000",
      "content": "<p>I wasn't able to replicate the problem. <code>unzip all.zip</code> works fine for me.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 420417,
      "author_name": "Dennis Alp",
      "author_url": "",
      "post_date": "2018-11-13T15:41:28.453000",
      "content": "<p>Doesn't work either, essentially the same problem</p>\n\n<pre><code>&gt;file all.zip \nall.zip: Zip archive data, at least v2.0 to extract\n&gt;zip -T all.zip \nwarning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n (attempting to process anyway)\nerror [all.zip]:  start of central directory not found;\n  zipfile corrupt.\n  (please check that you have transferred or created the zipfile in the\n  appropriate BINARY mode and that you have compiled UnZip properly)\ntest of all.zip FAILED\n\nzip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n&gt;tar -xvf all.zip \nx test_set.csv: ZIP compressed data is wrong size\ntar: Bad ZIP file\ntar: Error exit delayed from previous errors.\n</code></pre>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 420405,
      "author_name": "CPMP",
      "author_url": "",
      "post_date": "2018-11-13T15:30:15.637000",
      "content": "<p>Try downloading all. It worked for me.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 420385,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-11-13T14:43:35.177000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "420579": "Solved. From: https://unix.stackexchange.com/questions/115825/extra-bytes-error-when-unzipping-a-file\n\noriginally from https://brianchan.us/2013/12/30/need-pk-compat-v4-5-can-do-v2-1/\n\n'\"unzip\" on MAC OSX which cannot handle things zipped with PKZIP.\nI was able to brew install p7zip and unzip using the command 7za x some_file.zip'\n\nunzip doesn't work for me\n\n    &gt;unzip all.zip \n    Archive:  all.zip\n    warning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n      (attempting to process anyway)\n    error [all.zip]:  start of central directory not found;\n      zipfile corrupt.\n      (please check that you have transferred or created the zipfile in the\n      appropriate BINARY mode and that you have compiled UnZip properly)",
    "420380": "I just tried to download the data and I am not sure if I am missing something obvious, but I find that test_set.csv.zip is corrupt.\n\nThe file is recognized as a .zip file:\n\n    &gt;&gt;&gt; file test_set.csv.zip \n    test_set.csv.zip: Zip archive data, at least v2.0 to extract\n\nbut is corrupt:\n\n    &gt;&gt;&gt; zip -T test_set.csv.zip \n    warning [test_set.csv.zip]:  2994079001 extra bytes at beginning or within zipfile\n    (attempting to process anyway)\n    error [test_set.csv.zip]:  start of central directory not found;\n    zipfile corrupt.\n    (please check that you have transferred or created the zipfile in the\n    appropriate BINARY mode and that you have compiled UnZip properly)\n    test of test_set.csv.zip FAILED\n\n    zip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n\nand when trying uncompress:\n\n    &gt;&gt;&gt; tar -xvf test_set.csv.zip \n    x test_set.csv: ZIP compressed data is wrong size\n    tar: Bad ZIP file\n    tar: Error exit delayed from previous errors.\n\nAny ideas as to what the problem could be? I have the same problem by directly downloading using the graphical interface and using the API.\n\nThe number is supposed to be 453,653,104 lines, I find\n\n    &gt;&gt;&gt;wc -l test_set.csv\n    453652525 test_set.csv\n\nand\n\n    &gt;&gt;&gt;tail -n 2 test_set.csv\n    104853653,60072.9654,5,25.621115,24.916080,0\n    104853653,60077.9871,1,4.45339",
    "420488": "I wasn't able to replicate the problem. `unzip all.zip` works fine for me.",
    "420417": "Doesn't work either, essentially the same problem\n\n    &gt;file all.zip \n    all.zip: Zip archive data, at least v2.0 to extract\n    &gt;zip -T all.zip \n    warning [all.zip]:  3156501760 extra bytes at beginning or within zipfile\n     (attempting to process anyway)\n    error [all.zip]:  start of central directory not found;\n      zipfile corrupt.\n      (please check that you have transferred or created the zipfile in the\n      appropriate BINARY mode and that you have compiled UnZip properly)\n    test of all.zip FAILED\n\n    zip error: Zip file invalid, could not spawn unzip, or wrong unzip (original files unmodified)\n    &gt;tar -xvf all.zip \n    x test_set.csv: ZIP compressed data is wrong size\n    tar: Bad ZIP file\n    tar: Error exit delayed from previous errors.",
    "420405": "Try downloading all. It worked for me.",
    "420385": ""
  }
}