I want to compress about 100'000 files (that's what
find . -type f | wc -l says) with a total disk usage of 100 GB. Most of the files are small but just a handful of them makes up about 70 GB of the 100 GB.
I don't want to use tar or tar.gz for this because if I want to access the archive, File Roller first has to read in the entire archive from the external HDD before I can even see the file list. Same thing if I try to list the files on the terminal.
I don't need the rights management of tar because I can remember the few files which need other rights than the others. What compression algorithm should I use?
And while I'm at it: I make full disk backups with this command:
dd if=/dev/sda bs=32M | gzip -9 > /location/dateAndMachineName.gz
It does a pretty good compression. But do you know a better compression algorithm?