10

I need to unzip a file of about 6 GB. However, I can't do it neither right-clicking (it gives an error saying "empty archive") or in the terminal, showing the following for the latter:

$ ls
 fhs-3.0.pdf   IDrive   Tese.zip  'Transport Studies of Dual-Gated ABC and ABA Trilayer Graphene: Band Gap Opening and Band Structure Tuning in Very Large Perpendicular Electric Fields - Zou.pdf'

$ unzip Tese.zip
Archive:  Tese.zip
warning [Tese.zip]:  4294967296 extra bytes at beginning or within zipfile
  (attempting to process anyway)
file #1:  bad zipfile offset (local header sig):  4294967296
  (attempting to re-compensate)
 extracting: Tese/.DS_Store          
error: not enough memory for bomb detection

$ jar xvf Tese.zip
java.util.zip.ZipException: only DEFLATED entries can have EXT descriptor
    at java.base/java.util.zip.ZipInputStream.readLOC(ZipInputStream.java:313)
    at java.base/java.util.zip.ZipInputStream.getNextEntry(ZipInputStream.java:125)
    at jdk.jartool/sun.tools.jar.Main.extract(Main.java:1361)
    at jdk.jartool/sun.tools.jar.Main.run(Main.java:409)
    at jdk.jartool/sun.tools.jar.Main.main(Main.java:1681)

I don't think the file is corrupt because I unzipped the same file in a Mac recently.

My PC has 15 GB of RAM and 2 GB of swap memory.

Improve this question
6
  • unzip -l /path/to/your/Tese.zip the zip file could be corrupt.
    – nobody
    Dec 30, 2021 at 17:43
  • @nobody I don't think that's the case because I recently unzipped the same file on a mac. Nevertheless, I did what you wrote and it listed the files inside the zip
    – Rich Hard Fine Man
    Dec 30, 2021 at 18:17
  • unzip -v | head -n1 please edit your question please.
    – nobody
    Dec 30, 2021 at 18:36
  • @nobody edited the question. I can read the files, but I need to download them.
    – Rich Hard Fine Man
    Dec 30, 2021 at 23:50
  • Note that 4294967296 is exactly 4 GiB so that’s another hint toward’s Ferrybig’s answer.
    – Didier L
    Dec 31, 2021 at 13:14

3 Answers 3

Reset to default
23

Java only supports file in the ZIP format, not ZIP64. The same goes for the simple zip command

Zip files have a size limit of 4GB minus 1 byte, Zip64 have a limit of 16 EB minus 1 byte. MacOS makes zip64 files when the size of bigger than supported. The tool your desktop environment gives may have the same limitation

You need the proper tooling to read zip64 files. On the command line ditto can read those files, while on Java, you can use Apache Commons Compress

Improve this answer
4
  • thanks for your explanation! However, running ditto, it says that the command is not found. Looking at the Apache Commons Compress link you provided, commons.apache.org/proper/commons-compress/zip.html, I don't understand how to use it.
    – Rich Hard Fine Man
    Dec 31, 2021 at 17:52
  • Java added support for zip64 in 1.7 so any recent JRE should be able to read zip64 files. I have used this in the past for jars that had more than 65k classes. However there is a regression in certain JREs: bugs.openjdk.java.net/browse/JDK-8226530. So check your JRE version.
    – user1937198
    Jan 1, 2022 at 3:12
  • I’m 99% certain that there is no ditto port for Linux, and therefore no way to use it on Ubuntu (barring Darling, but that’s way too complex to talk about here). The best option in my experience for this type of thing on Linux is unar (the CLI version of The Unarchiver), which is available for Linux (sudo apt-get install unar on Ubuntu and Debian systems).
    – Austin Hemmelgarn
    Jan 1, 2022 at 18:08
  • And if all else fails, just use 7Zip with WineHQ. I've successfully used it to extract weird RAR files on a Raspberry Pi with WineHQ with Box86.
    – Ismael Miguel
    Jan 2, 2022 at 22:52
14

Both tools, unzip and jar, explicitly told you that the file is corrupt:

miguel@...$ unzip Tese.zip
...
warning [Tese.zip]:  4294967296 extra bytes at beginning or within zipfile
  (attempting to process anyway)
file #1:  bad zipfile offset (local header sig):  4294967296
  (attempting to re-compensate)

miguel@...$ jar xvf Tese.zip
java.util.zip.ZipException: only DEFLATED entries can have EXT 
...

If you could unzip it on a Mac, it might be possible that some Mac software created that ZIP file, but maybe in a nonstandard format (as far as ZIP file standardization goes) that only some Mac software can understand.

You could try to go to that Mac again, unzip it there and then create a compressed tar file from it, then take that tar file to your PC and unpack it.

Improve this answer
6
  • 4
    I've been filing bugs for stuff that explodes on encountering large zip files. ZIP64 is more than a decade old and an extension to the format put out by the format makers as a direct legal descendant of the original PKZIP. Implement it already or at least raise the error of "Zip64" not supported.
    – Joshua
    Dec 31, 2021 at 16:29
  • @HuHa where does it say that the file is corrupt? Nevertheless, did what you suggested, good idea! Thanks!
    – Rich Hard Fine Man
    Dec 31, 2021 at 18:38
  • I edited my answer to highlight the parts that indicate that.
    – HuHa
    Dec 31, 2021 at 20:57
  • Might want to try using 7-zip on it, which has supported ZIP64 forever.
    – barbecue
    Jan 1, 2022 at 17:49
  • The way this answer mentions Macs reminds me of 12-year old boys talking about girls.
    – Matthias Winkelmann
    Jan 1, 2022 at 18:52
8

You can test if your copy unzip supports the zip64 extension (and archives >4Gig) by running unzip -v and checking for the presence of ZIP64_SUPPORT. Below is what I get on my Ubuntu setup. Note it does have ZIP64_SUPPORT

If your unzip doesn't display ZIP64_SUPPORT, you need a newer version of unzip.

Alternatively, if your unzip does have ZIP64_SUPPORT the problem is something else. Can you share any details about how the zip file was created? Is the zip file publicly available anywhere?

$ unzip -v
$ unzip -v
UnZip 6.00 of 20 April 2009, by Debian. Original by Info-ZIP.

Latest sources and executables are at ftp://ftp.info-zip.org/pub/infozip/ ;
see ftp://ftp.info-zip.org/pub/infozip/UnZip.html for other sites.

Compiled with gcc 9.2.0 for Unix (Linux ELF).

UnZip special compilation options:
        ACORN_FTYPE_NFS
        COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
        SET_DIR_ATTRIB
        SYMLINKS (symbolic links supported, if RTL and file system permit)
        TIMESTAMP
        UNIXBACKUP
        USE_EF_UT_TIME
        USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
        USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
        UNICODE_SUPPORT [wide-chars, char coding: UTF-8] (handle UTF-8 paths)
        LARGE_FILE_SUPPORT (large files over 2 GiB supported)
        ZIP64_SUPPORT (archives using Zip64 for large files supported)
        USE_BZIP2 (PKZIP 4.6+, using bzip2 lib version 1.0.8, 13-Jul-2019)
        VMS_TEXT_CONV
        WILD_STOP_AT_DIR
        [decryption, version 2.11 of 05 Jan 2007]

UnZip and ZipInfo environment options:
           UNZIP:  [none]
        UNZIPOPT:  [none]
         ZIPINFO:  [none]
      ZIPINFOOPT:  [none]
Improve this answer
5
  • my unzip seems to have ZIP64_SUPPORT. The zip file was created automatically, by downloading a folder that I had previously uploaded to an online backup, so it's not publicly available.
    – Rich Hard Fine Man
    Dec 31, 2021 at 17:37
  • 2
    From the other answers there is a suggestion that the zip file was created in streaming mode. The standard unzip utility can extract most streamed zip files without any issues. To know for sure, can you run [zipdetails] (github.com/pmqs/zipdetails/blob/main/bin/zipdetails) against the file and post the results. This will dump all the metadata from the zip file. Output is a bit verbose, If you don't want to disclose the filenames in the zip file, use the --redact option. [Full disclosure: I'm the author of zipdetails]
    – pmqs
    Dec 31, 2021 at 18:00
  • thanks for your help! Running what you told me yields the following 000000000 LOCAL HEADER #1 04034B50 Can't use an undefined value as an ARRAY reference at /usr/bin/zipdetails line 757. I include the terminal image, imgur.com/a/kPjQLra. I guess I'm not doing what you told me in the right way. Sorry, this is very new to me.
    – Rich Hard Fine Man
    Dec 31, 2021 at 19:02
  • Even though you broke my code, it's a really interesting result. It means the backup service you are using creates non-standard zip files. Can you tell us the backup service you are using? That would allow me to see if I can reproduce your issue. One last thing to try. Run zipdetails - - scan Teste.zip This may take an age to run, so you need to be patient.
    – pmqs
    Dec 31, 2021 at 20:08
  • @RichHardFineMan the line number referenced in the error message you supplied, 757, comes from an old version of the zipdetails script that ships with Ubuntu. The version on github has lots of fixes to allow it to work with more unusual zip files. In the same directory where your zip file is stored, run wget https://raw.githubusercontent.com/pmqs/zipdetails/main/bin/zipdetails to get the most recent copy of zipdetails. Then run perl ./zipdetails Teste.zip. If that still spits out an error message, please post the message here and try running perl ./zipdetails --scan Teste.zip.
    – pmqs
    Jan 1, 2022 at 14:22

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.