Add New Rule
To add a new rule:
1. Open an existing profile and select the Rules tab.
Note: The Data Profiler .dp artifact is not supported in DataConnect 12.5 and therefore cannot be opened for editing. It has been replaced by a .dq (Data Quality) file and a .dq.rtc (Runtime Config) file. Please recreate the profile as .dq and .dq.rtc artifacts. You can right-click on the .dp file to view profile content in a JSON editor. Also note that some rules have been deprecated or replaced with new rules. For more information, see Deprecated Rules.
2. Click 
and select Add New Rule from the context menu or right-click anywhere in the Field/Rule pane and choose Add New Rule.
and select Add New Rule from the context menu or right-click anywhere in the Field/Rule pane and choose Add New Rule.The Add Rules dialog is displayed. This dialog allows you to add rules for a single field. To add rules to multiple fields, launch the dialog multiple times. The rule parameters can be configured once back in the editor.
3. Select a field from the Select Field Name drop-down list.
Based on the selected field, the available rules get listed in the Profiling, Remediation, and Data Prep tabs.
The Add Rule dialog is organized into two panes:
• The Left pane - The left pane comprises of three tabs which are Profiling, Remediation, and Data Prep. The available rules for the selected field are grouped on these tabs:
Rule Category | Description |
|---|---|
Profiling | Profiling rules are of the following types: • Some rules can be used to generate aggregate statistics, which help identify inaccuracies by examining aggregated values over large datasets. • Other rules are test rules that generate pass and fail statistics. Some of these rules also provide a method to invert the results into pass and fail files. For a complete list of Profiling rules, see Profiling Rules. |
Remediation | Remediation rules can help you to identify and correct errors, inconsistencies, and inaccuracies in source data. This can include tasks such as removing duplicate records, standardizing format and data types, and filling in missing values. For a complete list of Remediation rules, see Remediation Rules. |
Data Prep | Data Preparation rules are a set of Function rules and Conversion rules that help transform raw data into a clean, consistent, and structured format that is suitable for analysis. They generate pass and fail statistics based on success or failure, and they create derived fields (see Derived Fields) of the converted type. These derived or converted fields can then be used to build additional rules. For a complete list of Data Prep rules, see Data Prep Rules. |
• The Right pane - It allows you to view the Field Data Discovery for the selected Field Name (see Field Data Discovery).
Note:
- Derived fields are listed below all the source fields. See Derived Fields and Add Rules from Derived Fields.
- The rule execution follows the order the rules were added.
- Derived fields are listed below all the source fields. See Derived Fields and Add Rules from Derived Fields.
- The rule execution follows the order the rules were added.
4. Select a rule from Profiling, Remediation, or Data Prep tab.
The tabs display only those rule types which are supported for the selected field.
5. Click Finish.
The Add Rules dialog closes, focus returns back to the Rules tab, and the new rule is displayed on the Field/Rule pane. The rule details are displayed on the Rule Definition pane. A default rule name is provided which (with the exception of multifield rules) follows the <FieldName>_<RuleType> format. For example, City_IsNotBlank. You can edit the name or click Reset to revert to the default name.
Note: The underscore (_) character is the only special character allowed in the name. Rule names cannot begin with a digit. If a field or column in the source data starts with a digit, 'r_' will be prepended to any rules created based on that field.
Tip... To undo and redo this action, select Undo/Redo from the Edit dropdown menu (at top left) or click Ctrl+Z/Ctrl+Y (respectively).
6. Specify the rule parameters.
Note: The parameters may be different for different Rules. See Rule and Parameter Reference.
Note: Select the Invert Test option to report the opposite results in your pass or fail file. This parameter is displayed only for Compare to Constant, Compare to Field, and Matches Regex Rule.
7. Save the profile.
Last modified date: 04/17/2026