Managing Rules
You can add and manage rules on the Rules tab. Once executed, these rules will help identify anomalies and issues within specific data patterns, formats, and values. For more information about data profile rules, see Rule and Parameter Reference.
The rules toolbar that is displayed on the Rules tab, provides a means of managing rules and accessing the AutoGen wizard and the Inspecting Data and Auto Adding Rules functionality.
Tip... Hover over each toolbar item to view its description.
The following table provides information about the various toolbar icons:
Icons | Description |
|---|---|
 | Invokes the Inspect Data and Recommend Rules dialog. See Inspecting Data and Auto Adding Rules from Rules Tab. |
 | Invokes the AutoGen wizard. See Generating Rules using AutoGen Wizard. |
 | Adds a new rule. See Add Rule. |
 | Deletes selected rules. See Delete Rule. |
 | Enables selected rules. See Disable and Enable Rule. |
 | Disables selected rules. See Disable and Enable Rule. |
 | Clears or deletes all the rules from the rules pane. See Clear Rules. |
 | Allows rearranging rules by moving them up and down. One or both the icons are disabled if moving the rule up or down is not permitted. See Rearrange Rules. Note: We cannot rearrange the Profiling rules; moving rules up and down is only allowed within the Remediation rules. |
 | Displays a summary information of the rules that have been defined. See View Rules Summary. |
Add Rule
To add a new rule:
1. Open an existing profile and select the Rules tab.
2. Click 
or right-click and select Add a New Rule.
or right-click and select Add a New Rule.The Add Rules dialog is displayed. This dialog allows you to add rules for a single field. To add rules to multiple fields, launch the dialog multiple times. The rule parameters can be configured once back in the editor.
3. Select a field from the Select Field Name dropdown list.
Based on the selected field, the available rules get listed in the Profiling, Conversions, and Remediation tabs.
The Add Rule dialog is organized into two panes:
• The Left pane - The left pane comprises of three tabs which are Profiling, Conversions, and Remediation. The available rules for the selected field are listed on these tabs:
Tabs | Description |
|---|---|
Profiling | Profiling rules are of the following types: • Some rules can be used to generate aggregate statistics, which help identify inaccuracies by examining aggregated values over large datasets. • Other rules are test rules that generate pass and fail statistics. Some of these rules also provide a method to invert the results into pass and fail files. For a complete list of Conversion rules, see Profiling Rules. |
Conversions | Conversion rules transform one data type into a different output data type. They create a new in-memory field (see Derived Fields). Make sure that the data type of the corresponding field in the target schema is set to the output type. They generate pass and fail statistics based on conversion success or failure, and they create derived fields of the converted type. These derived or converted fields can then be used to build additional rules. For a complete list of Conversion rules, see Conversion Rules. |
Remediation | Remediation rules can help you to identify and correct errors, inconsistencies, and inaccuracies in source data. This can include tasks such as removing duplicate records, standardizing format and data types, and filling in missing values. For a complete list of Remediation rules, see Remediation Rules. |
• The Right pane - It allows you to view the Field Data Discovery for the selected Field Name (see Field Data Discovery).
Note:
- Derived fields are listed below all the source fields. See Derived Fields.
- The rule execution follows the order the rules were added.
- Derived fields are listed below all the source fields. See Derived Fields.
- The rule execution follows the order the rules were added.
4. Select a rule from Profiling, Conversions, or Remediation tab.
The tabs display only those rule types which are supported for the selected field.
5. Click Finish.
The Add Rules dialog is closed and focus returns back to the Rules tab, and the new rule is displayed on the Rules pane. The rule details are displayed on the Rule Definition pane. A default rule name is provided. However, you can edit the name or click Reset to revert to the default name.
6. In the Parameters section, select the Invert Test option if you want report the opposite results in your pass or fail file.
Note: This parameter is displayed only for Compare to Constant, Compare to Field, and Matches Regex Rule.
Note: Other parameters may also be displayed based on the other Rule Types that you select. For more information about rule parameters, see Rule and Parameter Reference.
Tip... .Right-click the rules pane and select the Undo or Redo option to undo or redo all rule operations.
Edit Rule
For more information on adding rules, see Add Rule.
To edit a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to edit.
The Rule Definition pane on the right, displays the rule details.
3. The following information is displayed for the selected rule:
Properties | Editable | Description |
|---|---|---|
Rule name | Yes | The rule name. You can edit the rule name. Click Reset to revert back to the default rule name. |
Field Name | No | The field on which the rule is applied. |
Rule Type | No | The type of rule that is applied on the field. See Rule and Parameter Reference. Tip... A Red Cross in a rule icon (for example  ) indicates that the rule has a parameter that has not been defined. |
Parameters | Yes | Some rules have associated parameters, allowing users to specify specific values or conditions. See Rule and Parameter Reference. |
4. Click Finish.
The Edit Rule window is closed and the updated rule information is saved.
Invert Rule Test
The Compare to Constant, Compare to Field, and Matches Regex rules display the Invert Test parameter which allows to report the opposite results in the pass or fail file. This option is also available when you add these rules (see Add Rule).
To invert a rule test:
1. Open an existing profile and select the Rules tab.
2. Select the rule for which to edit the Invert Test parameter.
The Rule Definition pane on the right, displays the rule details.
3. In the Parameters section, select Invert Test.
Select this option if you want to report the opposite results in your pass or fail file.
For example, the Compare To Constant rule that uses an equal Operator will pass a record and put it in the PASS_TARGET file if the field value is equal to the specified Constant value. Inverting this test will put that same record in the FAIL_TARGET file.
4. Click Finish.
The Edit Rule window is closed and the updated rule information is saved.
Delete Rule
To delete Rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to delete.
3. Click 
or right-click and select Delete Selected Rules.
or right-click and select Delete Selected Rules.A Delete Confirmation message is displayed.
4. Click OK.
The selected rule is deleted.
Tip... .Right-click the rules pane and select the Undo or Redo option to undo or redo a delete operation.
Disable and Enable Rule
You can choose to run a profile, with only specific rules enabled, to speed up the execution time. Thus by disabling not required rules you can concentrate on a specific rule based testing, and resetting before moving on to another field rule.
To disable a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to disable.
3. Click 
or right-click and select Disable Selected Rules.
or right-click and select Disable Selected Rules.The selected rule text looks disabled (is grayed out) and the icon changes to 
.
. Note: This option is enabled only when a rule is enabled.
To enable a rule:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to enable.
3. Click 
or right-click the row and select Enable Selected Rules.
or right-click the row and select Enable Selected Rules.The selected rule text is enabled and the icon changes to 
.
.Note: This option is enabled only when a rule is disabled.
Clear Rules
To clear all rules:
1. Open an existing profile and select the Rules tab.
2. Select the rule that you want to clear.
3. Click 
or right-click and select Clear All Rules.
or right-click and select Clear All Rules.All the rules in the rules pane are deleted.
Tip... Right-click the rules pane and select the Undo or Redo option to undo or redo a clear operation.
Rearrange Rules
Note: We cannot rearrange the Profiling rules; moving rules up and down is only allowed within the Remediation rules.
To rearrange rules:
1. Open an existing profile and select the Rules tab.
2. Select the Remediation rule that you want to move.
3. Click the up and down icons (
) to move the rule up or down.
) to move the rule up or down.Tip... One or both the icons are disabled if moving the rule up or down is not permitted.
View Rules Summary
To view summary report:
1. Open an existing profile and select the Rules tab.
2. Hover your cursor on 
.
.Help text displays the summary information on all the rule defined in the Profile.
Last modified date: 08/04/2024