[ale] Looking for duplicate photos

[pras at cycloeastern.com]

Only couple of enhancements I would make is 

make ls --sort...
to ls -ltr --sort as he said the pics might be nested in a directory.

Also

I would do 'chksum' and match that as well before the rm..

Just my 2 cents
-Prasanna Subash


On Sun, Feb 06, 2005 at 11:51:23AM -0500, Jim Patterson wrote:
> Trey,
> 
> The following script is primitive, but I think it should work fine for you.
> If you name if del_dup.sh, then run it with:
> ./del_dup.sh /photos /photos/* /photos/*/*
> 
> It does not recurse automagicaly, but you can extend it with too much
> work.  Just take the top level directory and use find to locate all the
> sub-directories.  Then pass that list to ls.  NOTE: you can not use
> ls -R since that breaks each directory into seperate sections.
> 
> Jim P.
> 
> #! /bin/sh
> 
> oldsize="-"
> oldfile="-"
> 
> for f in `ls --sort=size $*`
> do
>     dl=`ls -l "$f" | tr -s " "`
>     size=`echo $dl | cut -f 5 -d " "`
>     file=`echo $dl | cut -f 9 -d " "`
> 
>     if [ "$oldsize" = "$size" ]
>     then
>         if diff -q "$oldfile" "$file" >/dev/null
>         then
>             echo Deleting $file dup of $oldfile
>             rm "$file"
>         fi
>     else
>         oldsize=$size
>         oldfile=$file
>     fi
> done
> 
> On Sun, 06 Feb 2005 11:19:42 -0500, Trey Sizemore <trey at fastmail.fm> wrote:
> > I've got a number of photos from my digital camera stored on my machine
> > and a number of them are duplicates.  I was wondering if there was a
> > script that would identify the duplicates and their locations so I can
> > purge them to better organize and post.  There is a /photos directory
> > that itself contains both photos and other sub-directories so it would
> > need to search both the /photos directory and all sub-directories within
> > it.
> > 
> > Am I wishfully thinking?  I don't have experience with sed and awk
> > (although I've used grep and pipes in the past) but this is beyond my
> > limited understanding.
> > 
> > Thanks.
> > 
> > --
> > Cheers,
> > Trey
> > ---
> > 
> > "Men do not differ much about what things they will call evils;
> > they differ enormously about what evils they will call excusable."
> > -- GK Chesterton
> > 
> > 11:15AM up 3:03, 0 users, load averages: 0.39, 0.43, 0.61
> > FreeBSD salamander.thesizemores.net 5.3-STABLE i386
> > 
> > _______________________________________________
> > Ale mailing list
> > Ale at ale.org
> > http://www.ale.org/mailman/listinfo/ale
> >
> _______________________________________________
> Ale mailing list
> Ale at ale.org
> http://www.ale.org/mailman/listinfo/ale