Actian Data Observability allows you to compare the differences between your datasets. This feature is useful when you want to ensure data consistency across different tables, and can be used in data reconciliation or migration cases.

As part of scanning a dataset, Actian Data Observability checks for the differences between source and target tables (if configured). In the app, Actian Data Observability will provide summary stats on the number of new, missing and changed records. Outside the app, Actian Data Observability will store the changed or different records for further usage or analysis.

Actian Data Observability’s Data Diff feature runs as part of tables’ regular scan. You will first need to connect the two datasets, you want to compare, to Actian Data Observability using the steps defined here. Then, you will need to update the configs for the table you want to compare (target table) using these steps:

If any differences is detected across the source and target datasets, a “Data Difference” alert is created similar to below picture:

Clicking on the alert, will show more details on changed schema and records similar to picture below:

Lastly, navigating to the output parquet files, you can see more details on changed records, such as individual changes per each record.