User Guide > Designing and Executing Data Profile > Adding Rules from Rules Tab > Generating Rules using AutoGen Wizard
Was this helpful?
Generating Rules using AutoGen Wizard
AutoGen allows you to automatically generate rule for fields based on data type and or field name matching pattern. Actian DataConnect supplies one AutoGen ruleset (DefaultRules.rules). However, you can create your custom set of rules that are very specific for any dataset. There is no limit to the number of .rules files you can create.
The AutoGen .rules file contains a list of default rules that can be applied to any source dataset and executed. You can create a new .rules file or edit the existing .rules file. To use, create, edit, and view the AutoGen file, see the following topics:
To auto generate profile rules:
1. Open an existing profile, click Rules tab, and then click .
The AutoGen Wizard is displayed.
2. Select the fields on which you want to apply the rules:
a. From Available Fields box, click and select one field or [Ctrl]+Click to select multiple fields.
b. Click to move the selected fields to the Selected Fields box.
Note:  
- You can select fields from the Selected Fields box and move them back to the Available Fields box by clicking .
- You can move all the fields to the Selected Fields box by clicking .
- You can move back all the fields to the Available Fields box by clicking .
3. Select one of the following options to indicate how you wish to apply the rules:
• Apply All rules - Applies all the rules on the selected fields. This is also the default selection.
• Apply Best rule -Applies the first rule where the value of the field name pattern matches the most field names in the source dataset (excluding wild card matches).
• Apply First rule - Applies the first rule that matches a value or field.
4. (Optional) Choose a file from where to apply the rules. For this, click Browse and select the DefaultRules.rules file or a custom .rules file from the file directory and then click OK.
5. (Optional) Select the Remove selected field rules check box.
Select this option to remove any rules that already exist on the Rules tab for the fields selected in this AutoGen run. If you do not select this option, then additional rules are added for the selected fields, including potential duplicates automatically.
6. Click Next.
The Manage AutoGen Rules window is displayed. You can do the following tasks from this window:
• View the rules that are being added to the AutoGen .rules file - Click the order number (first column) to see the rules set for that data type or field name pattern on the right.
Note:  Rules are listed on the right based on the selected data type. The rules that appear selected are auto-generated for the specific data type or field name pattern when you click Finish.
• Edit a data type - Select the order number, click within the corresponding Type text box, click the dropdown arrow, and then select a new data type.
Note:  A few rules have parameters that are mandatory to configure. For example, Date Patterns, Timestamp Patterns, Sort Orders, and so on.
• Edit a Field Name Pattern - Select the order number, click within the corresponding Field Name Pattern text box, and then type the string that you want to match against the field names. You can use the wild card character “*” before or after the string. For example, *Name, which could match on First Name or Last Name.
Note:  Fields that match both data type (Type) and pattern (Field Name Pattern) will get the selected rules auto-generated.
• Create a new AutoGen .rules file - For more information, see Creating AutoGen rules file.
• Add an AutoGen rule - Click Add a new Rule. A new entry is added to Order, Type, and Field Name Pattern with corresponding default rules, which you can edit. The default data type is String.
• Remove an AutoGen rule - Select the order number and then click Remove.
• Change the order - Select the order number and then click Up to move the selected rule up in the list, or Down to move the selected rule down in the list.
• Apply AutoGen rules - Under Rules, select the rules that you want to apply to fields that match the corresponding data type (Type) and pattern (Field Name Pattern). For more information, see Rule and Parameter Reference.
Note:  You can select more than one rule by selecting the check box beside the required rule.
7. Click Finish.
A message box is displayed showing the location where the new or edited rules file has been saved.
8. Click OK.
The AutoGen Wizard is closed and the auto-generated rules are displayed in the rules pane. The new .rules file is saved as the rule file preference for future AutoGen runs.
IMPORTANT!  You can go to a previous step by clicking Back, and your configured information is not lost. You can also exit at any time by clicking Finish, and what you have configured is saved. You can later view and edit the rule information in the Rules tab of the Data Profile Editor.
Creating AutoGen rules file
The AutoGen .rules file contains a list of default rules that you can run automatically for your profiles to create rules. You can change the default list to include rules that you use frequently, and you can create different .rules files that are very specific to various datasets.
To create a new AutoGen rules file:
1. Open an existing profile, click Rules tab, and then click .
The AutoGen Wizard is displayed.
2. Select the fields and specify how to apply the rules. For more information, see Generating Rules using AutoGen Wizard.
3. Click Next.
The Manage AutoGen Rules window is displayed.
4. Specify a new file name in the Rules File Name text box, and then click New Rule File.
5. On the AutoGen Rules pane, add or edit the required rule.
6. Click Finish.
A message box is displayed showing the location where the new or edited rules file has been saved.
7. Click OK.
The AutoGen Wizard is closed and the auto-generated rules are listed in the rules pane. The new .rules file is saved as the rule file preference for future AutoGen runs.
Editing AutoGen rules file
To edit an AutoGen rules file:
1. Open an existing profile, click Rules tab, and then click .
The AutoGen Wizard is displayed.
2. At the bottom of the window, click Browse and select the required .rules file. The selected file with its path is displayed in the Apply rules from the following file text box.
3. Click Next.
The Manage AutoGen Rules window displays a list of rules associated with the selected .rules file
4. On the AutoGen Rules pane, add or edit the required rule. For more information, see Generating Rules using AutoGen Wizard.
5. Click Finish.
The Rule Saved message is displayed.
6. Click OK.
The AutoGen Wizard is closed and you are navigated to the Rules tab where the auto-generated rules are listed in the rules pane. The new .rules file is saved as the rule file preference for future AutoGen runs.
Viewing AutoGen Results
After an AutoGen profile run, you may notice that when you view the .dp.stats.json file, the table of fields, and rule includes additional fields that did not appear in your source file. These are derived fields that were created by AutoGen.
Derived Fields
Fields created by a rule or a script that are not included in the original data file or table. Function and conversion rule create output fields that are derived from an original field. For example, if your source data file has a string Birthdate field, then you can use the String to Date conversion rule to generate a date data type field. After which you create additional rule on the derived field. Contrast with source fields.
The following is an example of derived field usage:
If your field is a string but you know it should be a numeric field, and you want to test that the number is not greater than 2000, follow these steps:
1. First, convert your string field to a numeric field (see String To Conversion). This will create a derived field called d_FieldName_StringToConversion. This derived field will be present in the drilldown target.
2. Then, add the Compare to Constant rule after selecting this derived field.
3. Select the Operator as (>) and specify the Constant as (2000).
4. Click Finish.
Last modified date: 08/04/2024