Duplicate
Duplicate operations provides a way for you to identify a wide variety of duplicate data in your system. By generating a new duplicate identification infoset, you can apply filters, operations, reports, or actions to start your data deduplication process.
Duplicate operations compares objects of two infosets that are based on each other's hash value. If an object's hash value matches, the system can flag that object as a duplicate object. To conduct this operation, you must specify a primary infoset to apply against the infoset that you want to identify its duplicate objects. The operation then creates a new duplicate identification infoset that contains all duplicate objects except any objects from the primary infoset.