This release includes enhancements to the following connectors.
Adabas Connector
The new Table Name Override attribute is available in the Advanced source and target attributes for the Adabas connector. You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type or Target Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources or targets.
Amazon Redshift V2 Connector
This release includes the following enhancements for Amazon Redshift V2 Connector:
•Mapping in SQL ELT mode
You can configure Amazon S3 as a source in a Lookup transformation in a mapping.
Concur V2 Connector
You can overwrite the source connection and target connection at run time with values specified in a parameter file in a mapping.
Databricks Connector
This release includes the following enhancements for Databricks Connector:
•Mapping in SQL ELT mode
You can configure Amazon S3 and Microsoft Azure Data Lake Storage Gen2 as sources in a Lookup transformation in a mapping.
•You can configure a Databricks Delta connection to connect to Databricks Delta endpoints hosted on Google Cloud Platform.
•You can use Delta UniForm to read Delta tables formatted for Apache Iceberg.
•You can stage data in a Volume in Databricks when you run a Databricks mapping on a Windows machine.
Datacom Connector
The new Table Name Override attribute is available in the Advanced source attributes for the Datacom connector. You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources.
Db2 for i Connector
You can now override the schema and table names for Db2 for i source, lookup, and target objects. Either the new Schema Name or Table Name property or both can be populated. You can provide an override for these properties in the Advanced section of the mapping or mapping task. Alternatively, you can provide a parameter of type String and configure a parameter file for the mapping task.
Note: When you use a parameter for the new Schema Name and Table NameAdvanced source properties, the default value will not be used.
Db2 for z/OS Connector
You can now override the schema and table names for Db2 for z/OS source, lookup, and target objects. Either the new Schema Name or Table Name property or both can be populated. You can provide an override for these properties in the Advanced section of the mapping or mapping task. Alternatively, you can provide a parameter of type String and configure a parameter file for the mapping task.
Note: When you use a parameter for the new Schema Name and Table NameAdvanced source properties, the default value will not be used.
Db2 z/OS Unload Connector
The new Table Name Override attribute is available in the Advanced source attributes for the Db2 z/OS Unload connector. You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources.
File Processor Connector
You can use certain custom key exchange algorithms to connect to the SFTP server seamlessly.
For a list of custom key exchange algorithms that you can use, see the File Processor Connector documentation.
Google BigQuery V2 Connector
You can use a Normalizer transformation in a mapping in SQL ELT mode.
Google Cloud Storage V2 Connector
When you write data to Google Cloud Storage, you can optimize the upload of large files.
Hadoop Files V2 Connector
You can read or write column names that contain hash characters (#) in a mapping.
IBM MQ Connector
You can use a custom cipher suite for your SSL-enabled IBM MQ connection to securely connect to IBM MQ.
IDMS Connector
The new Table Name Override attribute is available in the Advanced source attributes for the IDMS connector. You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources.
IMS Connector
The new Table Name Override attribute is available in the Advanced source and target attributes for the IMS connector. The Table Name Override attribute is available for both group source and Multi Record Write (MRW). You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type or Target Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources or targets, including Multi-Record Write, by using the same syntax you use to specify Filter Overrides and SQL Query Overrides.
Kafka Connector
This release includes the following enhancements for Kafka Connector:
•You can read data in Realtime mode when the connection is configured to use the Confluent schema registry.
•You can read and write data using the Snappy and Zstd compression formats.
Marketo V3 Connector
You can read data from Smart Campaign source objects in Marketo.
Microsoft Azure Data Lake Storage Gen2 Connector
You can use the Delta file format in a mapping in advanced mode to read from or to create a Delta Lake in Microsoft Azure Data Lake Storage Gen2.
Microsoft Fabric Data Warehouse Connector
This release includes the following enhancements for Microsoft Fabric Data Warehouse Connector:
•Mapping in SQL ELT mode
- When you create a mapping in SQL ELT mode, you can extract data from Microsoft Azure Data Lake Storage Gen2 and load data to Microsoft Fabric Data Warehouse.
- You can use a Rank transformation in a mapping.
•You can access Microsoft Fabric Data Warehouse using an Azure Private Link endpoint.
•You can configure an SQL Transformation in a mapping to process a stored procedure.
•You can enable dynamic schema handling in a task to refresh the schema every time the task runs. This feature doesn't apply to mappings in advanced mode.
Microsoft Fabric Lakehouse Connector
You can access Microsoft Fabric Lakehouse using an Azure Private Link endpoint.
Microsoft Fabric OneLake Connector
You can access Microsoft Fabric OneLake using an Azure Private Link endpoint.
Microsoft SQL Server Connector
This release includes the following enhancements for Microsoft SQL Server Connector:
•You can configure Service Principal authentication to connect to Microsoft SQL Server database.
MongoDB V2 Connector
This release includes the following enhancements for MongoDB V2 Connector:
•You can bypass validation rules set for a MongoDB collection when you insert, update, or upsert data to MongoDB. This feature doesn't apply to mappings in advanced mode.
•You can write multi-level hierarchical data without flattening from a source to a target in a mapping. This feature doesn't apply to mappings in advanced mode.
•You can configure a cached Lookup transformation in a mapping to look up data from MongoDB.
•You can use a parameterized MongoDB V2 connection in the Source, Target, or Lookup transformation in a mapping.
•You can optimize performance for a mapping task that is based on a mapping by configuring the following partitioning:
- Key range partitioning to distribute the rows of source data based on the partition key and the range of values for each partition when you read data from MongoDB.
- Pass-through partitioning to partition data when you write data to MongoDB.
This feature doesn't apply to mappings in advanced mode.
Open Table Connector
This release includes the following enhancements for Open Table Connector:
•You can read from and write to Apache Iceberg tables stored on Amazon S3 and managed by the Apache Hive Metastore Catalog.
•You can view the job status of a mapping task, such as the count of processed and failed rows, on the Individual Task Results page.
Oracle Autonomous Database Connector
You can perform the following actions on the source data when you read from the Oracle Autonomous Database source:
•Select multiple source objects
•Select unique values from the data
•Filter and sort the data
•Run SQL commands before and after the agent reads the data
You can connect to Salesforce with the Salesforce API version up to 63.0, except the versions 58.0 and 61.0.
SAP BW BEx Query Connector
You can overwrite the source connection at run time with values specified in a parameter file in a mapping.
SAP BW Connector
You can overwrite the source connection at run time with values specified in a parameter file in a mapping.
SAP Connector
You can overwrite the source and target connections at run time with values specified in a parameter file in a mapping that uses an IDoc Reader, IDoc Writer, or SAP RFC/BAPI Interface connection type.
SAP HANA Connector
You can overwrite the source, target, and lookup connections at run time with values specified in a parameter file in a mapping.
SAP OData V2 Connector
This release includes the following enhancements for SAP OData V2 Connector:
•You can connect to the SAP server with the least load at run time in a mapping.
•You can use custom data queries to read from SAP OData V2 services.
SAP Table Connector
This release includes the following enhancements for SAP Table Connector:
•You can overwrite the source, target, and lookup connections at run time with values specified in a parameter file in a mapping.
•You can read data of the UTCL data type from an SAP object in a mapping.
•You can read data from an entity-based CDS view in a mapping.
•SAP Table Connector uses the latest transport requests ER6K900176 for the TABLE_READER transport.
Sequential Connector
The new Table Name Override attribute is available in the Advanced source and target attributes for the Sequential connector. The Table Name Override attribute is available for both group source and Multi Record Write (MRW). You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type or Target Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources or targets, including Multi-Record Write, by using the same syntax you use to specify Filter Overrides and SQL Query Overrides.
Snowflake Data Cloud Connector
This release includes the following enhancements for Snowflake Data Cloud Connector:
•Mapping in SQL ELT mode
You can edit the precision or scale of a field in the source or lookup object in a Snowflake mapping that reads from Amazon S3 or Microsoft Azure Data Lake Storage Gen2.
•Snowflake Data Cloud Connector uses JDBC driver version 3.21.0.
Teradata Connector
You can parameterize the system operator through a parameter file when you write to a Teradata target.
VSAM Connector
The new Table Name Override attribute is available in the Advanced source and target attributes for the VSAM connector. The Table Name Override attribute is available for both group source and Multi Record Write (MRW). You can override an imported table name from the following locations:
•The Advanced section in a Data Integration mapping
•The Advanced section in a mapping task for a mapping where the Source Type or Target Type is set to Parameter
•The parameter files where a string parameter is used to override the table name
You can override table names in Multi Group sources or targets, including Multi-Record Write, by using the same syntax you use to specify Filter Overrides and SQL Query Overrides.