Skip to main content

Unique Rows

Description

Unique rows, is a step in the Transformation Plugin for Process Studio Workflows. The Unique rows step passes unique rows by removing duplicate rows from the input stream(s). It is a prerequisite that input stream is sorted; otherwise, only consecutive double rows are evaluated correctly. Unique rows (HashSet) step does not need the rows to be sorted.

Configurations

No.Field NameDescription
1Step nameName of the step as it appears in the workflow workspace. This name has to be unique in a single workflow.
2Add counter to output?Check this option to add a counter field to the stream.
3Counter fieldDefine the counter field name.
4Redirect duplicate rowProcesses duplicate rows as an error and redirect rows to the error stream of the step. Requires you to set error handling for this step.
5Error DescriptionSets the error handling description to display when duplicate rows are detected. Only available when Redirect duplicate row is checked.
6Fields to compare tableSpecify the field names on which you want to force uniqueness or click Get to insert all fields from the input stream(s) You can choose to ignore case by setting the Ignore case flag to Y. For example: Tea, TEA, tea are the same if the compare is performed as case-insensitive. In this instance, the f irst occurrence (Tea) is passed to the next step(s).