duplicate

Remove duplicate files

Snippet Posted by kitt at 07:04 on 27 May 2018

Remove duplicated files on a unix-like filesystem

Recursively compares based on size, then mdsum, then byte-wise comparison.

Install from https://github.com/adrianlopezroche/fdupes

# identify and remove
fdupes -rdN .
 
# find them
fdupes -r dir > ~/duplicates.txt

Seen you before, have I?

Blog Written with a loving hand by kitt some time around 00:40 on 15 July 2008

I followed a random link today that took me to jointcontact, another website that uses "web 2.0" in its branding. I was a little puzzled at the image at the top of the page:

And then it dawned on me. I had seen it on one of my (now former) clients' sites:

I don't know why this should surprise me. Maybe the late (early?) hour?

Or maybe I was expecting this IntarWeb™ thing to be bigger. So big, in fact, that what's old is new again, and I don't stumble upon the same image twice.

I don't know why I thought that would be. This world just isn't that big.