Rule and Parameter Reference
The available rules can be grouped into the following types:
• Profiling Rules: Profiling rules can help you identify problems in source data. These rules are of the following types:
– Some rules can be used to generate aggregate statistics, which help identify inaccuracies by examining aggregated values over large datasets.
– Other rules are test rules that generate pass and fail statistics. Some of these rules also provide a method to invert the results into pass and fail files.
• Conversion Rules: Conversion rules transform one data type into a different output data type. They generate pass and fail statistics based on conversion success or failure, and they create derived fields of the converted type. These derived or converted fields can then be used to build additional rules.
• Remediation Rules: Remediation rules can help you to identify and correct errors, inconsistencies, and inaccuracies in source data. This can include tasks such as removing duplicate records, standardizing format and data types, and filling in missing values.
IMPORTANT!
- During profile execution, the Remediation rules are processed first followed by the Profiling Rules. The processing order ensures that the changes specified in the Remediation rules are applied to your data before the Profiling rules are evaluated.
- Rules can be configured in any order. While you can rearrange the Remediation rules by moving them up or down, the Profiling rules cannot be rearranged.
- The Remediation rules are executed in the order you create them or rearrange them on the Rules tab and the results may vary as per their order
- When replacing values in the target field, you may encounter a truncation error, often due to a mismatch in field sizes between the target field and the replacement value. To resolve this issue, adjust the field size of target field according to the replaced/overwritten value size.
Last modified date: 08/04/2024