jdupes

If you are regularly downloading files on your computer, then chances are that you are stuck with a collection of redundant and duplicate files. While you do manual removal for just a few files, the same cannot be said when it comes to dozens of files.

jdupes is a lightweight, command line utility designed to help you identify dupes and take proper actions, such as moving them to another folder or deleting them, for instance.

According to the developer, the program works with 100% matches and does not include a so-called similarity algorithm. What this means is that any chances to the ID3 tag of a file no longer makes it identical and hence, it does not show up in the results. In case you want to find similar files, then you need to find another third-party tool that features the “fuzzy match” feature.

Then again, the utility comes with advanced or expert options that can be employed in special situations. However, it is important to note that using such commands may lead to undesirable effects. For example, if you want to use the quick command (-Q) then the tool skips byte-by-byte duplicate verifications and this may delete non-duplicates as well.

Before you can get started, make sure to check out the documentation, as the program comes with a plethora of functions and commands. Providing that you selected the right option for your needs, the app displays the duplicate match set results with one file path per line and separated by a blank line. It makes it easier for you to process them via a shell script, for instance.

In the eventuality that you are looking for a tool to help you find and delete 100% identical dupes from your system, then perhaps you can consider giving jdupes a try.