Remadder

If your line of work entails performing regular backups, working with virtual machines or sharing large files with unstructured data across the servers, then is it likely that storage space is among your top concerns. Since searching for duplicates in huge databases cannot be performed manually, there is a chance that you are on the lookout for a deduplication solution.

Remadder is an application designed to help you automatically identify identical records and delete the redundant data, thus reducing the storage needs for files and backups considerably.

It is important to note that the application discovers duplicates using a pragmatic approach to the fuzzy match analysis, a method that enables you to explore the similarities between two sets of data when a unique identifier is not present.

You can explore data sets that you have reasons to believe they might contain duplicates by creating a project with a unique ID. The app allows you to import CSV databases, edit them and identify dupes by calculating the probability that the files have the same entity.

You will be happy to learn that the utility comes with an intuitive interface that includes several tabs that are representative for their functions. The projects created in this manner are saved locally and can be exported to CSV, XLS, XLSX or ODS.

You should know that the program enables you to specify the parameters of how the data comparison should be performed for each project. On a side note, you should keep in mind that the tool supports more than one solution with distinct parameters per project.

You can enter the solution definition by specifying its header via the data grid or the form view and select if you prefer the analysis employs the Trigram similarity function, Levenshtein distance function or both. While the first one a string that is more suitable for large deviations, the latter can be used to spot minor differences and hence, it is more resources extensive and takes longer.

In addition to the functions to be used, you can also specify if you prefer to use the composite field, an option that although requires more resources, it can provide you with more accurate results.

In the event that you are looking for a tool to help you manage large data sets in a way that can eliminate dupes and save space, then perhaps Remadder could come in handy.