This release includes enhancements to the following connectors.
Databricks Delta Connector
This release includes the following enhancements for Databricks Delta Connector:
•You can use the Databricks cluster version 13.3 LTS at runtime to process Databricks Delta mappings and tasks.
•You can use key range partitioning to distribute the rows of source data based on the partition key and the range of values for each partition.
Google BigQuery V2 Connector
This release includes the following enhancements for Google BigQuery V2 Connector:
•The Google BigQuery V2 Connector uses Spark BigQuery connector library to write the data in a mapping in advanced mode. This library utilizes the Google BigQuery Storage API to directly write the data into Google BigQuery and does not use Google Cloud Storage for intermediate staging.
•You can configure standard and materialized views in the following scenarios within a mapping:
- Configure the connection to use Google BigQuery Storage API for staging.
- Configure the retry strategy in the connection.
- Configure a source object with Record data type and repeated columns.
- Configure the EXPORT DATA statement for staging.
- Read the data in an advanced mode mapping.
Snowflake Data Cloud Connector
You can push a few additional functions such as bitwise expression, context, and aggregate functions to Snowflake when you create a mapping in SQL ELT mode.
For the list of supported functions, see the Snowflake Data Cloud Connector documentation.