Compiling email subscriber lists, keyword targets, or server access lists often results in repeated entries. This tool provides both global and consecutive deduplication options:
Given this list containing duplicate entries:
apple
orange
apple
apple
banana
orange
Applying Global deduplication retains only the first appearance of each unique item:
apple
orange
banana
Switching to Consecutive-only deduplication preserves repeated entries that appear in separate parts of the file while collapsing adjacent repeats (e.g., keeping the first and second apple blocks separate).