Managing Rules
You can add and manage rules on the Rules Tab. Once executed, these rules will help identify anomalies and issues within specific data patterns, formats, and values. For more information about data profile rules, see Rule and Parameter Reference.
Caution! When opening an existing Data Profile, if you’re using an older version (e.g., 12.3), you may encounter a dialog about the version migration to version 12.4. Please note that profiles migrated to version 12.4 are not backward compatible with older versions and this action is irreversible. If you need to use the profile again in version 12.3, create a copy beforehand.
To prevent this notification from appearing again, check the box labeled “Don’t show me this message again” and click OK. Your preference will be saved. To change this setting later, you’ll need to manually edit the dialog_preferences.properties file.
To prevent this notification from appearing again, check the box labeled “Don’t show me this message again” and click OK. Your preference will be saved. To change this setting later, you’ll need to manually edit the dialog_preferences.properties file.
Add New Rule
To add a new rule:
1. Open an existing profile and select the Rules tab.
2. Click 
and select Add New Rule from the context menu or right-click anywhere in the Field/Rule pane and choose Add New Rule.
and select Add New Rule from the context menu or right-click anywhere in the Field/Rule pane and choose Add New Rule.The Add Rules dialog is displayed. This dialog allows you to add rules for a single field. To add rules to multiple fields, launch the dialog multiple times. The rule parameters can be configured once back in the editor.
3. Select a field from the Select Field Name drop-down list.
Based on the selected field, the available rules get listed in the Profiling, Remediation, and Data Prep tabs.
The Add Rule dialog is organized into two panes:
• The Left pane - The left pane comprises of three tabs which are Profiling, Remediation, and Data Prep. The available rules for the selected field are grouped on these tabs:
Rule Category | Description |
|---|---|
Profiling | Profiling rules are of the following types: • Some rules can be used to generate aggregate statistics, which help identify inaccuracies by examining aggregated values over large datasets. • Other rules are test rules that generate pass and fail statistics. Some of these rules also provide a method to invert the results into pass and fail files. For a complete list of Profiling rules, see Profiling Rules. |
Remediation | Remediation rules can help you to identify and correct errors, inconsistencies, and inaccuracies in source data. This can include tasks such as removing duplicate records, standardizing format and data types, and filling in missing values. For a complete list of Remediation rules, see Remediation Rules. |
Data Prep | Data Preparation rules are a set of Function rules and Conversion rules that help transform raw data into a clean, consistent, and structured format that is suitable for analysis. They generate pass and fail statistics based on success or failure, and they create derived fields (see Derived Fields) of the converted type. These derived or converted fields can then be used to build additional rules. For a complete list of Data Prep rules, see Data Prep Rules. |
• The Right pane - It allows you to view the Field Data Discovery for the selected Field Name (see Field Data Discovery).
Note:
- Derived fields are listed below all the source fields. See Derived Fields and Add Rules from Derived Fields.
- The rule execution follows the order the rules were added.
- Derived fields are listed below all the source fields. See Derived Fields and Add Rules from Derived Fields.
- The rule execution follows the order the rules were added.
4. Select a rule from Profiling, Remediation, or Data Prep tab.
The tabs display only those rule types which are supported for the selected field.
5. Click Finish.
The Add Rules dialog closes, focus returns back to the Rules tab, and the new rule is displayed on the Field/Rule pane. The rule details are displayed on the Rule Definition pane. A default rule name is provided which (with the exception of multifield rules) follows the <FieldName>_<RuleType> format. For example, City_IsNotBlank. You can edit the name or click Reset to revert to the default name.
Note: The underscore (_) character is the only special character allowed in the name. Rule names cannot begin with a digit. If a field or column in the source data starts with a digit, 'r_' will be prepended to any rules created based on that field.
Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
6. Specify the rule parameters.
Note: The parameters may be different for different Rules. See Rule and Parameter Reference.
Note: Select the Invert Test option to report the opposite results in your pass or fail file. This parameter is displayed only for Compare to Constant, Compare to Field, and Matches Regex Rule.
7. Save the profile.
Edit Rule
For more information on adding rules, see Add New Rule.
To edit a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to edit.
The Rule Definition pane on the right, displays the rule details.
3. The following information is displayed for the selected rule:
Rule Definition | Editable | Description |
|---|---|---|
Rule name | Yes | A default rule name is provided and is displayed here. The default rule name (with the exception of multifield rules) follows the <FieldName>_<RuleType> format. For example, City_IsNotBlank. You can edit the name or click Reset to revert to the default name. Note: The underscore (_) character is the only special character allowed in the name. Rule names cannot begin with a digit. If a field or column in the source data starts with a digit, 'r_' will be prepended to any rules created based on that field. |
Field Name | No | The field name to which the rule applies is displayed here, along with the data type in parentheses. For example, ZIP (String). |
Rule Type | No | The type of rule that is applied to the field. See Rule and Parameter Reference. Tip... A Red Cross in a rule icon (for example  ) indicates that the rule has a parameter that has not been defined. |
Parameters | Yes | Some rules have associated parameters, allowing users to specify specific values or conditions. See Rule and Parameter Reference. |
4. Edit the required rule details and save the profile.
Invert Rule Test
The CompareToConstant, CompareToField, and MatchesRegex rules display the Invert Test parameter which allows to report the opposite results in the pass or fail file. This option is also available when you add these rules (see Add New Rule).
To invert a rule test:
1. Open an existing profile and select the Rules tab.
2. Select the rule for which to edit the Invert Test parameter.
The Rule Definition pane on the right, displays the rule details.
3. In the Parameters section, select Invert Test.
Select this option if you want to report the opposite results in your pass or fail file.
For example, the Compare To Constant rule that uses an equal Operator will pass a record and put it in the PASS_TARGET file if the field value is equal to the specified Constant value. Inverting this test will put that same record in the FAIL_TARGET file.
4. Save the profile.
Delete Rules
To delete Rules:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to delete.
Note: Press Ctrl + Click to select multiple rules individually, or Ctrl + Shift to select a continuous range of rules.
3. Click the delete button, click 
, or right-click and select Delete Rule(s).
, or right-click and select Delete Rule(s).A Delete Confirmation message is displayed.
4. Click OK.
The selected rule is deleted. Deleting a rule that generates a derived field will also remove the derived field and any other rules linked to it.
Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
5. Save the profile.
Disable and Enable Rules
You can run a profile with only specific rules enabled to speed up execution time. By disabling not required rules, you can focus on a testing specific rules, resetting them before moving on to another field rule.
To disable a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to disable.
Note: Press Ctrl + Click to select multiple rules individually, or Ctrl + Shift to select a continuous range of rules.
3. Click 
or right-click and select Disable Rule(s).
or right-click and select Disable Rule(s).The selected rule is disabled (is grayed out) and the icon changes to 
.
. Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
4. Save the profile.
To enable a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to enable.
Note: Press Ctrl + Click to select multiple rules individually, or Ctrl + Shift to select a continuous range of rules.
3. Click 
or right-click and select Enable Rule(s).
or right-click and select Enable Rule(s).The selected rule is enabled and the icon changes to 
.
.Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
4. Save the profile.
Clear All Rules
To clear all rules:
1. Open an existing profile and select the Rules tab.
2. Click 
.
.3. The Delete Confirmation message is displayed.
4. Click OK to delete all rules.
Caution! Deleting rules that produce derived fields will also delete the derived field and rules associated with the derived fields.
Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
5. Save the profile.
Reorder Rules
To reorder rules:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to move.
3. Click the up and down buttons (
) to move the rule up or down. You can also use drag and drop to reorder rules.
) to move the rule up or down. You can also use drag and drop to reorder rules.Note:
- Rules can be reordered via drag-and-drop within the same field but dragging a rule outside its parent field displays a “NO DROP” icon and has no effect.
- Reordering is only supported for remediation rules.
- One or both the up/down buttons are disabled if moving the rule up or down is not permitted.
- Rules can be reordered via drag-and-drop within the same field but dragging a rule outside its parent field displays a “NO DROP” icon and has no effect.
- Reordering is only supported for remediation rules.
- One or both the up/down buttons are disabled if moving the rule up or down is not permitted.
4. Save the profile.
View Rules Summary
To view summary report:
1. Open an existing profile and select the Rules tab.
2. Hover your cursor on 
.
.Help text displays the summary information on all the rule defined in the Profile.
Last modified date: 09/22/2025