Rule and Parameter Reference
When a rule type is configured against a field, a default rule name is provided which (with the exception of multifield rules) follows the <FieldName>_<RuleType> format. For example, City_IsNotBlank. The rule name can be modified, and all references to the rule are automatically updated.
The underscore (_) character is the only special character allowed in the name. Rule names cannot begin with a digit. If a field or column in the source data starts with a digit, 'r_' will be prepended to any rules created based on that field. This prefix will also be added to any rule name that does not start with an alphabetic character.
The available rules types are grouped into the following categories:
• Profiling Rules: Profiling rules can help you identify problems in source data. These rules can serve several purposes:
– Some rules can be used to generate aggregate statistics, which help identify inaccuracies by examining aggregated values over large datasets.
– Other rules are test rules that generate pass and fail statistics. Some of these rules also provide a method to invert the results into pass and fail files.
• Remediation Rules: Remediation rules can help you to identify and correct errors, inconsistencies, and inaccuracies in source data. This can include tasks such as removing duplicate records, standardizing format and data types, and filling in missing values.
• Data Prep Rules: Data Preparation rules are a set of Function rules and Conversion rules that help transform raw data into a clean, consistent, and structured format that is suitable for analysis. They generate pass and fail statistics based on success or failure, and they create derived fields of the converted type. These derived or converted fields can then be used to build additional rules.
IMPORTANT!
- During profile execution, the Remediation rules are processed first followed by the Profiling Rules. The processing order ensures that the changes specified in the Remediation rules are applied to your data before the Profiling rules are evaluated.
- Rules can be configured in any order. While you can reorder the Remediation rules by moving them up or down, the Profiling rules cannot be reordered.
- The Remediation rules are executed in the order you create them or reorder them on the Rules tab and the results may vary as per their order
- When replacing values in the target field, you may encounter a truncation error, often due to a mismatch in field sizes between the target field and the replacement value. To resolve this issue, adjust the field size of target field according to the replaced/overwritten value size.
Last modified date: 09/22/2025