Enhanced connectors

Common

• •You can configure AWS private link to enable private communication between the serverless runtime environment and service network endpoints hosted on the AWS platform.
This enhancement applies to the connectors listed in the following table:

- Amazon Redshift V2 Connector - File Processor Connector - Kafka Connector - Microsoft SQL Server Connector - ODBC Connector - Oracle Connector - MongoDB V2 Connector

- REST V2 Connector - Salesforce Connector - Salesforce Analytics Connector - Salesforce Marketing Cloud Connector - Shopify Connector - Teradata Connector

• •You can use the following connectors in tasks that run in an elastic runtime environment:

- ActiveCampaign Connector - Adobe Analytics Connector - Amplitude Connector - Eloqua Bulk API Connector - FileIo Connector - Hadoop Files V2 Connector - JMS Connector

- Kafka Connector - Magento V1 Connector - Mailchimp Connector - Mixpanel Connector - OData Connector - Salesforce Analytics Connector - Shopify Connector

Amazon Athena Connector

• •Amazon Athena Connector uses the AWS SDK version 2.30.15 and the Athena JDBC driver version 3.7.0.
• •You can use a credential profile file that stores AWS credentials, such as access keys and secret keys, to authenticate access to Amazon Athena.
• •You can read data of Array, Struct, and Map data types in a mapping.
• •You can configure a connection and mapping in one environment and then migrate and run the mapping in another environment using a different connection.

Amazon S3 V2 Connector

• •You can read from and write to delta format files in a mapping in advanced mode.
• •You can read from and write to Apache Iceberg tables in Amazon S3 in a mapping. You can also read from Apache Iceberg tables in Amazon S3 in a mapping in advanced mode.
• •You can use a checksum algorithm in a mapping that writes to Amazon S3.

Amazon SageMaker Lakehouse Connector

Concur V2 Connector

Databricks Connector

• •When you read from Databricks, you can sort data based on a sort condition before the data enters the data flow.
• •You can read data from external tables in Text, JSON, Avro, and ORC formats in Databricks. You can also write to and create external tables at runtime in Text, JSON, Avro, ORC, Parquet, and CSV formats.
• •Databricks Connector uses the AWS SDK version 2.30.15 to stage data in Amazon S3.
• •You can configure the Secure Agent to automatically retrieve the primary key columns if the source table contains them. Therefore, you no longer need to explicitly specify the primary key columns in the Update Columns advanced target property.

DB2 Loader Connector

Google Cloud Storage V2 Connector

Hadoop Files V2 Connector

• •You can use Amazon EMR version 7.12.0 as a distribution version for Hadoop Files V2 Connector.
• •You can preview data in a mapping that reads from and writes to Avro, Parquet, ORC, and Flat files. You can also apply a limit to the number of rows to preview.

Hive Connector

JMS Connector

IBM MQ Connector

Kafka Connector

Klaviyo Connector

Microsoft Azure Data Lake Storage Gen2 Connector

• •You can read from Apache Iceberg files in a mapping in advanced mode.
• •When you run a mapping in advanced mode, you can read data from a file with no header.

Microsoft Fabric Data Warehouse Connector

• •You can specify additional connection properties in a Microsoft Fabric Data Warehouse connection to configure parameters such as retry count, retry interval, and login timeout, thereby enhancing connection resiliency.
• •When you write data to Microsoft Fabric Data Warehouse, you can specify additional runtime properties to configure retry delay, maximum number of retries, and the SQL endpoint in the lakehouse where data is stored temporarily.

Microsoft Fabric Lakehouse Connector

Microsoft Fabric OneLake Connector

• •You can read from Apache Iceberg files in a mapping in advanced mode.
• •You can read from and write to Avro files in a mapping in advanced mode.

Microsoft SQL Server Connector

• •You can configure the updated JDBC driver version 6.0.0.001957 available in the LATEST folder to run all your mappings and tasks.
For more information about configuring this driver, see How to configure the updated JDBC driver with Microsoft SQL Server Connector Knowledge article.
• •You can sort the source fields in ascending or descending order in a mapping.

MongoDB V2 Connector

• •When you write data to a MongoDB V2 target, you can omit columns with null values.
• •You can delete all documents from MongoDB collections before writing data to the target in a mapping. This enhancement doesn't apply to mappings in advanced mode.
• •You can configure an error threshold that a mapping task can encounter before it fails. This enhancement doesn't apply to mapping tasks that are based on mappings in advanced mode.
• •You can use an authenticated and unauthenticated SOCKS proxy server to connect to MongoDB.
• •You can connect to MongoDB version 8.x using a MongoDB V2 connection.

MySQL Connector

ODBC Connector

• •You can connect to a DB2 z/OS database using the DB2 subtype in the connection.
• •You can sort the source fields in ascending or descending order in a mapping.

Oracle Connector

• •You can configure the following updated JDBC and ODBC driver versions available in the LATEST folder to run all your mappings and tasks:
• - JDBC: 6.0.0.001794
• - ODBC: 08.02.3863
For more information about configuring these drivers, see How to configure the updated JDBC and ODBC drivers with Oracle Connector Knowledge article.
• •You can connect to Oracle using LDAP authentication.
• •You can sort the source fields in ascending or descending order in a mapping.

Oracle Eloqua Bulk API Connector

Open Table Connector

• •When you write to Open Table, you can configure a mapping to manage table history and storage, remove unreferenced files from snapshots, and consolidate manifest files to optimize performance.
• •You can perform update, upsert, and delete operations in a mapping.
• •You can configure cross-account access when the Secure Agent running on an EC2 instance is in one AWS account, while Iceberg tables, Glue Catalogs, and Athena workgroups reside in a different AWS account.

PostgreSQL Connector

• •You can configure the updated JDBC driver version 6.0.0.001843 available in the latest folder to run all your mappings and tasks.
For more information about configuring this driver, see How to configure the updated JDBC driver for PostgreSQL Connector Knowledge article.
• •You can read and write data of UUID data type in a mapping.
• •When you write to PostgreSQL, you can configure the commit interval.
• •When you write to PostgreSQL, you can configure the CDC recovery.
• •You can configure a stored function in an SQL transformation.

REST V2 Connector

Salesforce Connector

Salesforce Data 360 Connector

• •Salesforce Data Cloud Connector is renamed to Salesforce Data 360 Connector.
• •You can read data from multiple data spaces in mappings and mapping tasks.
• •When you write data to Salesforce Data 360, you can select target objects from an Ingestion API Connection. You can also create a new target object at run time.
• •You can enable dynamic schema handling in a task to refresh the schema every time the task runs.
• •You can use a custom query to read from multiple source objects.

SAP BAPI Connector

SAP BW BEx Query Connector

SAP BW Connector

• •You can override the source connection at run time with values specified in a parameter file.
• •You can read data from Open ODS View objects in SAP BW/4HANA applications.
• •SAP BW Connector uses the latest transport requests B42K900171 for the BW4HANA transport.

SAP HANA Connector

• •You can override the source, target, and lookup connections at run time with values specified in a parameter file.
• •When you read from or write to SAP HANA, you can perform the following actions on the data:
• - Override the default SQL query.
• - Override the schema specified in the connection.
• - Override the table name of the imported SAP HANA table.

SAP OData V2 Connector

• •When you read data in smaller chunks by enabling pagination on the SAP server side.
• •You can read column names with Unicode characters from hierarchical entities.

SAP OData V4 Connector

• •You can use OAuth 2.0 authorization code and OAuth 2.0 client credentials authentication to connect to SAP S/4HANA applications.
• •You can use SAP query parameters to connect to SAP S/4HANA or SAP Datasphere applications using an SAP OData V4 connection.
• •You can insert data to hierarchical entities in SAP S/4HANA applications.

SAP Table Connector

Snowflake Data Cloud Connector

• •Mapping in SQL ELT mode
You can optimize the mapping performance by pushing a few conditional expression, regular expression, and string and binary functions to Snowflake.
For the list of functions that you can push down to Snowflake, see the Snowflake Data Cloud Connector documentation.
• •You can use Programmatic Access Token authentication to connect to Snowflake.
• •You can configure Google Cloud Private Link to enable private communication between the Secure Agent and Snowflake endpoint hosted on the Google Cloud platform.
• •When you read data from Snowflake, you can optimize performance for a mapping task by configuring fixed partitioning. This enhancement doesn't apply to mapping tasks that are based on mappings enabled with SQL ELT optimization, mappings in advanced mode, and mappings in SQL ELT mode.
• •When you look up data from Snowflake, you can configure the precision of datetime fields in a cached connected or unconnected lookup. This enhancement doesn't apply to mappings enabled with SQL ELT optimization, mappings in advanced mode, and mappings in SQL ELT mode.

Tableau V3 Connector

• •You can use an authenticated and unauthenticated proxy server to connect to Tableau V3.
• •When you create a new target at runtime, you can retain the exact source field names in the target.