Hello, i have many folders with pictures and some of them are duplicates, is there an app that can detect that?

  • 🎧MutatedBass🖱️@beehaw.org
    link
    fedilink
    arrow-up
    4
    ·
    10 months ago

    Here’s a script from GPT4:

    #!/bin/bash
    
    # Create a temporary file for storing file checksums
    tempfile=$(mktemp)
    
    # Generate MD5 checksums for all files in the current directory and its sub-directories
    find . -type f -exec md5sum '{}' \; | sort > $tempfile
    
    # Detect and delete duplicates
    awk 'BEGIN {
        lasthash = "";
        lastfile = "";
    }
    {
        if ($1 == lasthash) {
            print "Deleting duplicate file: " $2;
            system("rm -f \""$2"\"");
        } else {
            lasthash = $1;
            lastfile = $2;
        }
    }' $tempfile
    
    # Clean up
    rm -f $tempfile
    

    This script can be run with Termux from the root of your internal storage. Usually /sdcard or /storage/emulated/0. Do not confuse this with running from root if you are rooted.

    Before using a script that interacts with your files you should backup anything that is important just in case.

    Furthermore, if you comment out:

    system("rm -f \""$2"\"");
    

    By adding a # in front of it like this:

    # system("rm -f \""$2"\"");
    

    You can run the script and see what files the script would delete without actually deleting them. I would recommend doing this as I have not tested this script.