28

I have some 500 files of 650MB each, named bigfile.000 to bigfile.199 and I need to calculate the MD5 checksum of all files combined. The command I am using is:

cat bigfile.* | md5sum

I have the time, and I understand it will take hours to complete, but I still want to check the progress. Is there any way to do so? Like piping something in between and do a word count that doesn't affect performance much?

2
  • possible duplicate of Progress and speed with 'cp'?
    – karel
    May 9, 2014 at 11:38
  • 4
    I think it's not a duplicate question - they are different questions but simply the same answer that solves two different problems. cp is different from cat anyway.
    – Kenneth L
    May 12, 2014 at 6:45

2 Answers 2

33

Use pv. It is in the repos, and shows a nice progress bar.

pv bigfile.* | md5sum  

should do what you want.

4

Progress bar plus stats: ETA, ...:

pv -pteIrabT file | md5sum

For example:

# pv -pteIrabT hugefile.tar.lzo | sha1sum 
7.59GiB {----} 0:03:22 [39.1MiB/s] [38.5MiB/s] [>                          ]  7% ETA 0:41:47 ETA 19:45:26
1
  • 1
    This doesn't seem to give any more output than just using pv without any options.
    – SiHa
    Jun 29, 2021 at 10:35

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.