Finding a large number of duplicates manually is quite time consuming. To facilitate the task, it is recommended to use special programs, since the computer was designed to make work easier. The weight of such programs is usually very small, so you can download it in a matter of seconds.
Necessary
Text Duplicate Killer Software
Instructions
Step 1
To find duplicates, you need to install this program. To do this, copy the files from the zip archive to any empty directory. After its launch, it is necessary to bring the experimental file to the ASCII format. The utility is launched by double clicking on the tdk.exe file.
Step 2
In the main window of the program, click the top menu "File" and select "Open source file". In the window that opens, specify the file for which the duplicate search will be performed.
Step 3
Click the "File" menu and select "Set target file" - specify the name of the file to which the results will be written.
Step 4
To start the process of removing duplicates, click the top menu "Operations" and select the option "Remove duplicates". Despite the duration of the entire process, you can interrupt the work progress at any time, for this press the "Stop" button. For this program, the rule is that with a large volume, stopping the process takes longer than for a small file.
Step 5
The name of the target file can be set independently, or you can entrust this task to the program. To do this, click on the button with the image of a magic wand. It is worth noting that in order to perform the operation multiple times for different files, it is necessary to set new names, otherwise the results of previous attempts will be irrevocably deleted.
Step 6
Use the Options menu to configure additional parameters. To search for duplicates regardless of their case, select the "Ignore case" item. For example, Register, register and REGISTER after enabling this option will be considered by the program as duplicates. It will also be useful to activate the "Ignore leading and trailing spaces" option - spaces before and after the word will be automatically skipped, i.e. the words "order", "order" and "order" will be identical.
