Release Version | Details |
|---|---|
12.4.0-49 | First patch release for DataConnect 12.4. See Change Log for 12.4 (Build Number 12.4.0-49). |
12.4.0-32 | First release for DataConnect 12.4. See Change Log for 12.4 (Build Number 12.4.0-32). |
Category | New Feature/Enhancement |
|---|---|
Connectors | Newly added connectors include: |
Data Profile Alert Management Preferences | Data Profile Alert Management Preferences let you configure key settings for the alert notification feature, including the threshold value, SMTP server details, and subscriber email addresses. These settings can be defined globally in the Preferences or individually within each Data Profile. To apply the same settings to all new data profiles by default, configure them in the Preferences (see Setting Data Profile Preferences). If you want to customize alert settings for a specific profile, you can override the global settings by configuring them directly in that profile under Execution Options (see Configuring Execution Options). • Threshold value - You can now define threshold values for Data Quality Index (DQI) scores. When the data quality index value is lower than the specified threshold, the system will trigger notifications—provided the SMTP server setting is configured. This feature helps you proactively monitor data quality and respond quickly to potential issues. While thresholds and alerts are separate features, they work together to deliver meaningful notifications. You can set the threshold value from the Preferences page or directly in that profile under Execution Options. • SMTP server details - You can setup your SMTP server configuration from the Preferences page (see Setting Data Profile Preferences and Setting SMTP Server Preferences) or directly in that profile under Execution Options. • Subscriber email addresses - You can setup your alert notification subscribers from the Preferences page or directly in that profile under Execution Options. |
Data Profile Execution Options | Execution options are available on the Configuration tab and allow you to Enable Notifications, Configure an SMTP Server, Set Data Quality Index Threshold, and Define Subscribers. You can also turn on or off, writing to the Pass and Fail targets under the Execution Options. |
Data Profile Wizard | • The Add Recommended Rules to Profile page of the Data Profile wizard, now lets you select rules from a list of Recommended Rules. You can also edit these rules and view the Field Data Discovery associated with each rule field. • The Configure Targets page of the Data Profile wizard, now lets you optionally choose to write Pass/Fail results to the respective PASS_TARGET and FAIL_TARGET files. You can also turn off writing to the Pass and Fail targets on the Configuration tab under Execution Options. |
Web Service Invoker | The deprecated Web Service Invoker component, retired earlier, is still in use by some customers. Due to lack of a direct replacement, this Invoker will now be available/visible when a customer uses a previously configured Web Service Invoker component (in an earlier versions). |
Security Updates | Security Update - CVE-2025-27636, CVE-2025-29891 (Severity: High) Component Affected: org.apache.camel_camel-support (version 3.18.0) Updated File: camel-support-3.18.0.jar Security Update - CVE-2025-48976, CVE-2024-47554 (Severity: High) Component Affected: commons-fileupload (version 1.5) Updated File: commons-fileupload-1.5.jar Security Update - CVE-2021-28168 (Severity: High) Component Affected: org.glassfish.jersey.core_jersey-common (version 2.30) Updated File: jersey-common-2.30.jar Security Update - CVE-2025-53864 (Severity: High) Component Affected: nimbus-jose-jwt (version 9.37.3) Updated File: nimbus-jose-jwt-9.37.3.jar Security Update - CVE-2021-28170, CVE-2020-15250 (Severity: Medium) Component Affected: jakarta.el (version 3.0.2) Updated File: jakarta.el-3.0.2.jar Security Update - CVE-2023-22899 (Severity: Medium) Component Affected: net.lingala.zip4j (version 2.11.1) Updated File: zip4j-2.11.1.jar Security Update - CVE-2023-51074 (Severity: Medium) Component Affected: json-path (version 2.8.0) Updated File: json-path-2.8.0.jar Security Update - CVE-2019-10219 (Severity: Low) Component Affected: org.hibernate.validator_hibernate-validator (version 6.0.17.Final) Updated File: hibernate-validator-6.0.17.Final.jar Security Update - CVE-2020-10693 (Severity: Low) Component Affected: org.hibernate.validator_hibernate-validator (version 6.0.17.Final) Updated File: hibernate-validator-6.0.17.Final.jar |
Category | New Feature/Enhancement |
|---|---|
AutoGen | The AutoGen feature has been deprecated and is no longer visible in the New Data Profiler Wizard or the Data Profile Editor. You can use Ruleset Files instead. |
Connectors | Newly added connectors include: Other connector enhancements include: • URI support has been added to the JSON v2 connector. • File based connectors within Map Designer can now connect to files stored in GZip, DJMessage, Azure, FTP, FTPS, GCP, Google Drive, HTTP, HTTPS, AWS S3 or SFTP. This enhancement allows users to directly read and write files to any of these storage options. (For information, see URI Connections, Source File/URI Options, Target File/URI Options, Specifying Source Connector, Parts, and Properties, and Specifying Target Connector, Parts, and Properties). |
Ruleset Files | Ruleset files enable you to save and reuse the rules you create. A ruleset file (.ruleset) stores the rules, organized by Data Type and Field Name Pattern. These rules can be applied to any data profile that contains fields of the specified data type and field names matching the defined pattern. See Ruleset Files, Import Ruleset, and Export Ruleset. |
Data Profile | Conversion Rules (PhoneticStringEncode and StringToConversion) have been merged into Data Prep Rules. Newly added rules include: • Assert (Profiling rule) - This profiling rule enables you to write regular expressions for building custom rules that are tailored for your dataset. You can reference values across multiple fields in your data, set a condition (Equal, Greater, Greater or Equal, Lesser, Lesser or Equal, Not Equal, Starts With, Ends With and Matches) to compare two different expressions against each other, or compare an expression against a field value, a constant or a lookup, and compare to see if the value is blank or null. • StandardizeFormat (Remediation Rules) - The StandardizeFormat rule can be used to change the format of fields that contain values such as zip codes and phone numbers. • DeidentifyValue (Remediation Rules) - The DeidentifyValue rule masks or encrypts data so that it cannot be linked to an individual. • ExecuteExpression (Data Prep Rules) - The ExecuteExpression rule executes the specified expression. This is useful for complex transformations. • LookupValue (Data Prep Rules) - The LookupValue rule allows you to perform a lookup (search and retrieve values from another dataset). • ParseExtract (Data Prep Rules) - The ParseExtract rule enables users to parse and extract parts from a structured or composite field value (such as an URI, Email, Full Name, Address, and Timestamp). • StringJoin (Data Prep Rules) - The StringJoin rule combines multiple fields into a single value, based on a specified delimiter. A derived field is auto-generated for the new value. • StringSplit (Data Prep Rules) - The StringSplit rule splits a string value in a field into separate substrings, or parts, based on a specified delimiter. A derived field is auto-generated for each part. Other updated rules include: |
Expression Builder Dialog | The Expression Builder dialog helps you construct expressions for Derived Fields. This dialog provides a list of available fields, operators, and functions you can use to build expressions. See Using the Expression Builder. |
Dimensions | Dimensions can now optionally be associated with profile rules which enables reporting per dimension. At the end of profile execution, each dimension generates a score based on pass/fail results. You can also assign rule importance (Weight) to each profile rule which is reflected in the dimension score. Dimensions have labels that represent universally accepted data quality characteristics (Accuracy, Completeness, Consistency, Timeliness, Uniqueness, and Validity). However, the profile designer decides which profile rules to associate with each dimension. See Rules Tab and Managing Data Quality Dimensions. |
Data Quality Index Score | A Data Quality Index score is now generated after a profile is executed. See Viewing Statistics. |
Derived Fields | The derived field section has been updated. See Derived Fields, Add Rules from Derived Fields and Add Source/Derived Fields to Output. |
Lookups | Lookups can now be created in the Profile Editor and used with the Replace with Lookup option in the ReplaceValue rule as well as the LookupValue rule. A lookup is useful when you want to use a field from the source dataset as a "key" into a different data source (the lookup) in order to retrieve a different value from the lookup data source. See Managing Lookups in Profile Editor. |
Inspect Data and Recommend Rules wizard | You can use the Inspect Data and Recommend Rules wizard to run internal algorithms that analyze the source data and suggest rules based on the source schema and various data pattern matching tests, and to also look for any useful profile or remediation rules that are saved in your Ruleset. This method is recommended if you're unsure about potential issues in your source data. |
Rules tab | The Rules tab has been updated. The Rules tab now displays fields and their associated rules in a tree view, with each rule organized under its corresponding field. See Rules Tab, Managing Fields. |
Data Profile Target Schema | By default, all source fields are considered as output fields (the fields that will be written to the target) and listed under OutputFields section. Output fields can be renamed, reordered, or deleted. You can also Add New Field to output and Map Field. See Managing Fields. |
Setting Preferences | • New Inspect and Recommend settings have been added to the Data Profiler preferences page. See Setting Data Profile Preferences. • The Data Profile preferences page has been updated for the date, timestamp, and time pattern settings. See Setting Data Profile Rule Defaults. |
Others | • You can now drag and drop fields and rules to reorder them. • Any actions related to the schema view, such as adding, removing, or reordering fields and rules, now have Undo/Redo functionality. • Right-click context menu options are now available for adding new rules and fields, deleting rules and fields, and adding source/derived fields to the output. • You can now copy and paste regex patterns and data formats from the Data Discovery > Possible Data Types tab to different rules. • You can now open the log file in an external editor after running maps, processes, or data profiles. • The supported Eclipse version for 12.4 has been upgraded to eclipse-2023-12. • The DataConnect Windows release now includes the embedded OpenJDK Runtime Environment Temurin-17.0.13+11 (build 17.0.13+11). |