File Deduplication Using Hashing

Design a solution to remove duplicate files in a file system. First, hash each file to detect duplication. Then, classify files based on their sizes for initial filtering and hash within each class to identify duplicates. Additionally, consider how to minimize communication among servers in a distributed system. Example Input ['/path/to/file1', '/path/to/file2', '/path/to/file3']