Skip to main content

Table Compare

Description

Table Compare compares the data between two database tables that share at least a partial column layout and identifies differences between them. Use this step for data validation, migration verification, or synchronization checks — for example, confirming that a target table matches its source after an ETL load. The step outputs detailed analysis including record counts, matched rows, differences, and join errors as fields that you can log, report on, or use to trigger corrective actions.

Configurations

Field NameDescription
Step nameSpecify the name of the step as it appears in the workflow workspace. This name has to be unique in a single workflow.
Reference connection /Compare connectionDatabase connections from which the reference/compare table data will come.
Reference schema field / Compare schema fieldSpecify the field that contains the schema names for the reference/compare table.
Reference table field / Compare table fieldSpecify the field that contains the actual table names. This means that you could compare two tables with a different name, as long as they have the same column names.
Key fields fieldSpecify a field that contains a comma separated list of the fields that make up the 'primary' key of the table(s) you are comparing. The primary key is needed because without this information the two tables cannot be correctly joined.
Exclude fields fieldSpecify the field that contains a comma separated list of columns that you want to exclude from the comparison. E.g. because they exist in the first table, but not in the second.
Number of errors fieldSpecify the name of the output column that will contain the total number of errors found for the comparison of your tables.
Number of reference table records fieldSpecify the name of the field that will contain the actual number of records found in the reference table.
Number of compare table records fieldSpecify the name of the field that will contain the actual number of records found in the compare table.
Number of left join errors fieldSpecify the name of the field that will contain the number of records that are only present in the reference table.
Number of inner join errors fieldSpecify the name of the field that will contain the number of records that show a difference between common records.
Number of right join errors fieldSpecify the name of the field that will contain the number of records that are only present in the compare table.
Error handling key description input fieldSpecify the output field names that will be used by the error handling of this step to describe the key(s) on which an error occurred.
Error handling reference value input fieldSpecify the output field names that will be used by the error handling of this step to describe the reference value that caused an error.
Error handling compare value input fieldSpecify the output field names that will be used by the error handling of this step to describe the compare value that caused an error.