Unique Rows (HashSet)
Description
Unique Rows (HashSet) is a step in the Transformation Plugin for Process Studio Workflows. The Unique Rows (HashSet) step removes duplicate rows and leaves only unique row occurrences. The Unique Rows (HashSet) step tracks duplicates in memory and does not require a sorted input to process duplicate rows.
Configurations
| No. | Field Name | Description |
|---|---|---|
| 1 | Step name | Name of the step as it appears in the workflow workspace. This name has to be unique in a single workflow. |
| 2 | Compare using stored row values | Stores values for the selected fields in memory for every record. Storing row values requires more memory, but it prevents possible false positives if there are hash collisions. |
| 3 | Redirect duplicate row | Processes duplicate rows as an error and redirect rows to the error stream of the step. Requires you to set error handling for this step. |
| 4 | Error description | Sets the error handling description to display when duplicate rows are detected. Only available when Redirect duplicate row is checked. |
| 5 | Fields to compare table | Lists the fields to compare---no entries means the step compares an entire row |