This release includes enhancements to the following connectors.
Common
This release includes the following enhancement for Flat File Connector, Teradata Connector, and Relational connectors that support partitioning:
•You can configure partitioning for a parameterized Source transformation from the mapping task. You can also override the partition details configured in the mapping from the mapping task.
Amazon Redshift V2 Connector
This release includes the following enhancements for Amazon Redshift V2 Connector:
•You can create a mapping in SQL ELT mode when you extract data from the following sources and load data to Amazon Redshift:
- Amazon Redshift
- Amazon S3
•You can configure a SQL statement in an Amazon Redshift V2 connection to set up the database environment that applies for the entire session.
•You can configure a virtual private cloud endpoint to enable private communication between the Secure Agent and the AWS Security Token Service or AWS Key Management Service for staging.
•The JDBC driver version is upgraded to 2.1.0.26.
Databricks Connector
This release includes the following enhancements for Databricks Connector:
•You can create a mapping in SQL ELT mode when you extract data from the following sources and load data to Databricks:
- Amazon S3
- Databricks
- Microsoft Azure Data Lake Storage Gen2
•SQL ELT enhancement
You can define expressions in a data driven condition to flag rows for an insert, update, delete, or reject operation.
•You can configure a virtual private cloud endpoint to enable private communication between the Secure Agent and Amazon S3 or AWS Security Token Service for staging.
Google BigQuery V2 Connector
This release includes the following enhancements for Google BigQuery V2 Connector:
•You can create a mapping in SQL ELT mode when you extract data from the following sources and load data to Google BigQuery:
- Amazon S3
- Google BigQuery
- Google Cloud Storage
•You can use the MD5 function with Base16 format in a mapping enabled with SQL ELT optimization.
•You can set the default column value for the return field in a cached and connected Lookup transformation in a mapping.
Greenplum Connector
You can use Kerberos authentication to connect to Greenplum.
Hive Connector
You can connect to Hive on a Cloudera CDP Private Cloud 7.1 distribution enabled with Knox to read or write data.
IBM MQ Connector
You can configure two-way secure communication in the IBM MQ connection to connect to IBM MQ.
IMS Connector
The IMS connector can now read data from a nonrelational data source with multiple record types and write the multiple record types to a nonrelational target, while maintaining the sequence of data. When you configure a mapping, select the new Multi Group option for the Source Type and Target Type. This feature is useful when you need to preserve the sequence of data for applications that must process the data in a specific order, or if you want to filter a portion of the records to obtain a smaller subset of records.
JDBC V2 Connector
You can configure a SQL statement to set up the database environment for a PostgreSQL endpoint using JDBC V2 Connector that applies for the entire session.
Microsoft Azure Data Lake Storage Gen2 Connector
You can use the Delta file format to read a Delta Lake or create a Delta Lake in Microsoft Azure Data Lake Storage Gen2.
Microsoft Azure Synapse SQL Connector
This release includes the following enhancements for Microsoft Azure Synapse SQL Connector:
•You can set the default column value for the return field in a Lookup transformation in a Microsoft Azure Synapse SQL mapping. This feature doesn't apply to mappings in advanced mode.
•You can configure the Parquet staging file format to stage files in Azure storage when you write data to Microsoft Azure Synapse SQL.
Microsoft Fabric Data Warehouse Connector
This release includes the following enhancements for Microsoft Fabric Data Warehouse Connector:
•You can use a Microsoft Fabric Data Warehouse connection in mappings to read from and write data to Microsoft Fabric Data Warehouse.
•You can use a hosted agent or Azure serverless runtime environment in a Microsoft Fabric Data Warehouse connection.
Microsoft Fabric Lakehouse Connector
This release includes the following enhancements for Microsoft Fabric Lakehouse Connector:
•You can use a Microsoft Fabric Lakehouse connection in mappings to read from and write data to Microsoft Fabric Lakehouse.
•You can use a hosted agent or Azure serverless runtime environment in a Microsoft Fabric Lakehouse connection.
Microsoft Fabric OneLake Connector
You can use a hosted agent or Azure serverless runtime environment in a Microsoft Fabric OneLake connection.
Microsoft SQL Server Connector
You can run Microsoft SQL Server mappings using the upgraded JDBC driver version 6.0.0.001475 or ODBC driver version 08.02.1617. These drivers are available in the latest folder in the Secure Agent installation directory. The previous latest drivers are available in the base folder. For information on using the latest driver, see How to use the patched or latest JDBC or ODBC driver for Oracle and Microsoft SQL Server Connectors.
Oracle Cloud Object Storage Connector
You can configure authenticated or unauthenticated HTTP proxy in Oracle Cloud Object Storage Connector.
ODBC Connector
You can configure a SQL statement to set up the database environment for a PostgreSQL endpoint using ODBC Connector that applies for the entire session.
Oracle Connector
You can run Oracle mappings using the upgraded JDBC driver version 6.0.0.001235 or ODBC driver version 08.02.3140. These drivers are available in the latest folder in the Secure Agent installation directory. The previous latest drivers are available in the base folder. For information on using the latest driver, see How to use the patched or latest JDBC or ODBC driver for Oracle and Microsoft SQL Server Connectors.
PostgreSQL Connector
You can configure a SQL statement to set up the database environment for a PostgreSQL connection that applies for the entire session.
Sequential Connector
The Sequential connector can now read data from a nonrelational data source with multiple record types and write the multiple record types to a nonrelational target, while maintaining the sequence of data. When you configure a mapping, select the new Multi Group option for the Source Type and Target Type. This feature is useful when you need to preserve the sequence of data for applications that must process the data in a specific order, or if you want to filter a portion of the records to obtain a smaller subset of records.
SharePoint Online Connector
You can now use the Microsoft Entra ID authentication type to connect to SharePoint Online.
Snowflake Data Cloud Connector
This release includes the following enhancements for Snowflake Data Cloud Connector:
•Mapping in SQL ELT mode
You can push a few conditional expression, cortex, date and time, and window functions to Snowflake.
For the list of supported functions, see the Snowflake Data Cloud Connector documentation.
•You can improve the writing performance of a Snowflake mapping that uses a CDC source and Snowflake target.
Workday V2 Connector
You can configure a Web Services transformation in a mapping that reads from Workday to include descriptors in the response.
VSAM Connector
The VSAM connector can now read data from a nonrelational data source with multiple record types and write the multiple record types to a nonrelational target, while maintaining the sequence of data. When you configure a mapping, select the new Multi Group option for the Source Type and Target Type. This feature is useful when you need to preserve the sequence of data for applications that must process the data in a specific order, or if you want to filter a portion of the records to obtain a smaller subset of records.