I have downloaded a 120 GB dataset in a tar.gz using Download Accelerator Plus, and used the following command to extract it:
tar -xvzf train_val2018.tar.gz
The dataset, when extracted, should contain a little more than 8,142 folders and exactly 461,939 image files.
When I open up the extracted folder, it does contain parts of the dataset. However, a huge portion of it is missing - it only contains 3,542 folders and 179,689 files.
Using the file explorer or the built-in file extractor GUI to extract it on Ubuntu only does worse. I've tried various applications on Windows as well, like WinZip, WinRAR, and 7Zip. None of these work, but the issue with them is that they had memory issues with such a large dataset.
Could the file be corrupted? The file has the same size as they've mentioned in the dataset website, and I've downloaded several larger files with DAP, and I've never encountered a corruption issue. For this reason, I'd like to know if there's some limitation with the built-in extractor or another issue.
The dataset I'm referring to is the iNaturalist 2018 Contest Dataset.