This release includes enhancements to the following connectors.
Amazon Athena Connector
You can configure an EC2 instance to assume an IAM role and use temporary security credentials to connect to Amazon Athena.
Amazon Redshift V2 Connector
You can push window functions to Amazon Redshift in a mapping in SQL ELT mode.
For the list of functions that you can push down to Amazon Redshift, see the Amazon Redshift V2 Connector documentation.
Amazon S3 V2 Connector
This release includes the following enhancements for Amazon S3 V2 Connector:
•You can use the document file format to read PDF files in a mapping in advanced mode.
•When you use discover structure and document file format in a mapping in advanced mode, you can incrementally load source files from a directory to read and process only the files that have changed since the last time the mapping ran.
Databricks Connector
This release includes the following enhancements for Databricks Connector:
•You can read delta format files from Amazon S3 and Microsoft Azure Data Lake Storage Gen2 sources in a mapping in SQL ELT mode and mapping task configured for SQL ELT optimization.
•You can use the Databricks cluster version 15.4 LTS at runtime to process Databricks mappings and tasks.
Google BigQuery V2 Connector
This release includes the following enhancements for Google BigQuery V2 Connector:
•You can use Workload Identity Federation authentication to connect to Google BigQuery.
•You can edit the precision of binary, decimal, and string data types, and the scale of the decimal data type for Google Cloud Storage or Amazon S3 sources in a SQL ELT mode mapping.
•You can read and write JSON data using Google BigQuery Storage API or hybrid connection mode.
Kafka Connector
You can write Avro data as wire format with complex schemas, such as nested and hierarchical structures, to Confluent Kafka with a schema registry by using Intelligent Structure Discovery.
Microsoft Azure Synapse SQL Connector
You can use the copy command to load data from Microsoft Azure Data Lake Storage Gen2 to Microsoft Azure Synapse SQL in a mapping task configured for SQL ELT optimization.
Microsoft Fabric Data Warehouse Connector
This release includes the following enhancements for Microsoft Fabric Data Warehouse Connector:
Mapping in SQL ELT mode
•You can edit the precision and scale of a field in the source or lookup object in a mapping in SQL ELT mode that reads from Microsoft Azure Data Lake Storage Gen2.
•You can push window functions to Microsoft Fabric Data Warehouse.
For the list of supported functions, see the Microsoft Fabric Data Warehouse Connector documentation.
Microsoft SQL Server Connector
This release includes the following enhancements for Microsoft SQL Server Connector:
•You can run a mapping using one of the following upgraded driver versions:
•You can configure and run the environment SQL queries in the same session within a Target transformation.
NetSuite Connector
You can now use the NetSuite Web Service Description Language (WSDL) versions 2024_2 to 2022_1 to access NetSuite data.
ODBC Connector
You can connect to Teradata database version 20.x using the Teradata subtype in an ODBC connection.
Oracle Connector
This release includes the following enhancements for Oracle Connector:
•You can run a mapping using one of the following upgraded driver versions:
- JDBC EBF driver: 6.0.0.001506
- JDBC Latest driver: 6.0.0.001574
To use these JDBC drivers, you need to update the Secure Agent configuration. For more information about configuring these drivers, see the How to configure the JDBC driver for Oracle Connector Knowledge Base article.
•You can join tables across the schemas when you use multiple objects as the source type.
Snowflake Data Cloud Connector
This release includes the following enhancements for Snowflake Data Cloud Connector:
•You can write to an Apache Iceberg target table created at run time.
Teradata Connector
You can connect to Teradata database version 20.x with TTU version 20.x and JDBC driver version 20.x.