The October 2024 release of Data Integration includes the following new features and enhancements.
Watch the What's New video to learn about new features and enhancements in the October 2024 release.
Enhanced validation for window functions in mappings in SQL ELT mode
Validation for mappings in SQL ELT mode is enhanced to catch errors related to required attributes in window functions. For example, if you use a window function in an Expression transformation in a mapping that loads data to Snowflake and you forget to enter a value for a required attribute, mapping validation fails. This enhancement helps to prevent the mapping task from failing at runtime.
For more information about mappings in SQL ELT mode, see Mappings.
Flat file formatting options
When formatting flat files, you can create headers for data rows.
Hierarchical mappers
Hierarchical mappers include the following new features:
•Add variables to the source and target schemas.
•Use a subtree from the source schema as the target schema.
•Import mapping statements from a CSV file.
•Upload an input file and run a preview of the hierarchical mapper to test the output.
For more information, see Components.
Notifications
Use the Notifications page to view and manage notifications from the past 30 days. You can also set up email notifications in your user settings.
Pulling mapping tasks and shared sequences
When you pull a mapping task or shared sequence from a source control repository, you can determine how to set in-out parameter values and both non-shared and shared sequence values in existing and new assets.
For more information, see Asset Management.
Running mapping tasks
When a mapping task that processes change data from a CDC source is stopped, you have the option to restart it from the beginning of the task or to resume from where it last ended.
For more information, see Tasks.
Stored procedure run order
When you call multiple source or target pre- or post-load stored procedures in unconnected SQL transformations in a mapping, you can specify the run order of stored procedures of the same type.
Successful and failed rows in the REST API activity log
When you use the activityLog REST API resource to get logs for a mapping task or dynamic mapping task that is based on a mapping in advanced mode, the response shows the successful and failed rows for each source and target in an advanced cluster subtask.
Successful and failed rows are available with certain connectors. For more information, see the help for the appropriate connector.