Take the 2-minute tour ×
Ask Ubuntu is a question and answer site for Ubuntu users and developers. It's 100% free, no registration required.

What can I use to find duplicate photos, including photos that have been resized?

share|improve this question
1  
Related: photo.stackexchange.com/questions/26026/… –  unor Nov 27 '12 at 18:35

5 Answers 5

up vote 23 down vote accepted

digiKam Install via the software center

Add all the photos to your collection. In the menu, select “Tools / Find duplicates”. This will look for duplicates across your whole collection.

findimagedupes Install via the software center

A command line tool. Pass all the images you want to compare on the command line.

Geeqie (formerly GQview) Install via the software center

In the menu, select “File / Find duplicate”. Drag and drop image files do the duplicates window. You can drop directories to add their contents recursively.

share|improve this answer
2  
I found that Geeqie works the best. It has a robust set of search modes(name,checksum,size,etc...), powerful Image similarity scanning, detailed info of found duplicates, Simple UI, and there's no need to add images to a collection or album first. My only Cons is that the Duplicate Finder is hidden under the File menu and you have to Drag&Drop from Nautilus(or other FM) in order to add Images/Folders to be searched. Other than that it gets the Job done and does it well. –  japzone Feb 25 '13 at 3:40
    
Geeqie can find similar images and it works pretty well, but I found it a bit slow for exact matches and it tedious to remove many duplicates with it. –  Wernight Jul 15 '13 at 7:16

Visipics

Visipics is a free Windows application for that function, but works just fine on Linux, via wine, of course (It's better than geeqie/gqview regarding the sorting of the duplicates (geeqie's results are absolutely "un-sortable")).

You can tell it to auto-select the images based on criteria such as smaller file size, non-compressed type, lower resolution (it won't do the opposite though, you'd need to do it manually, which wouldn't be much better than doing it on geeqie, except that the selection doesn't require holding Shift/Ctrl), and even prioritize folders (but the last priority is folder priority).

In my experience it doesn't do any stupid accident with symlinks, like selecting the same file twice or something like that.

share|improve this answer

imgSeek Install imgseek

imgSeek can find duplicates as well as similar pictures (so it should be able to find resized photos and photos with different filenames and metadata) and even search photos based on a sketch. It is available in desktop and server versions.

I haven't actually tried it myself, though.

share|improve this answer
    
only available for Ubuntu 10.04, though there is a perl library for 12.04 –  drevicko Mar 30 at 3:06
    
The server version isk-daemon works on 12.04, though I found I had to install from source (pip install as per the instalation page didn't work) –  drevicko Mar 30 at 11:46

fdupes Install fdupes

You can use a command line tool called fdupes to find duplicate files (see man fdupes for more details). I don't know of any way to find 'duplicates' that have been resized. A program that did this would require some sort of intelligent algorithm that analysed the image contents because when an image is resized, its data is changed so traditional duplicate finding methods would not work.

share|improve this answer
    
fdupes will also miss duplicates in different directories; let's say you have two copies of a photo one in folder birthday-party/ and the other in family-stuff/ ... "fdupes -fr ." will miss this duplicate. –  lrkwz Mar 11 at 22:57

FSlint Install FSlint

fslint is a graphical program that can find duplicate files of any type by md5sum. If the images are not identical, they won't be flagged as duplicates. The image below shows a bunch of duplicate pdf files in my Downloads directory:

enter image description here

You can change the advanced search parameters to search by file type and restrict yourself to images only. That's done through changing the "extra find parameters" as find command options. For example, here I am only looking for *.jpg files (in the same path, only looking at my "Downloads" folder:

enter image description here

fdupes Install fdupes

fdupes is an equivalent command-line based tool. Both are available in the repos.

share|improve this answer
4  
Note that I doubt these programs will find resized duplicates. –  Vadi Oct 9 '12 at 23:51
    
@Vadi that's a different, and more complicated question. Tineye does image identification which doesn't rely on metadata, hashes, etc (it can identify similar looking images) but that's an online service. They provide an API but I'm not aware of any applications that take advantage of this yet. The other complication is that you wouldn't want to remove similar images all the time, for example if you edit photos but want to keep copies of the originals. Removing identical duplicates is much safer. –  jozzas Oct 10 '12 at 0:03

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.