I have a big folder with hundreds of thousands of files. Total size is 10GB
The idea is that I want to archive this folder so I can transfer it to another server faster than file by file.
I tried with tar cfj archive.tar.bz2 dir-to-be-archived/
but it still seems to be slow.
I don't care about the final size because the network connection works up to 100mb/s in transfer.
I heard something about lzop
but I didn't understood exactly how to use it.
So is there anyway to create an archive really fast, like in 10-15 minutes?
cfj
would create a file namej
, instead of usingbzipz
compression. Usecjf
instead. And why wait till the archive is created? Start sending immediately:tar cj dir-to-be-archived | ssh target 'cd some/where; tar xj'
tar cfj
format will work regardless of the position off
(apart from first), its the usualtar -cfj
that won't work..