Databricks Connector

Issue	Description
CCON-95737	When you use the Databricks runtime version 14 and run a Databricks mapping in advanced mode, the mapping fails with the following error: Error:org.apache.spark.sql.delta.actions.InvalidProtocolVersionException: Delta protocol version is too new for this version of the Databricks Runtime. Please upgrade to a newer release. (July 2024)
CCON-92957	When you use IIF() function with ISDATE() function in a Databricks mapping enabled for SQL ELT optimization, the mappings fails with the following error: java.lang.ClassCastException: org.apache.spark.sql.execution.datasources.v2.DataSourceV2Relation cannot be cast to org.apache.spark.sql.execution.datasources.LogicalRelation (February 2024)
CCON-92943	When you run a Databricks mapping enabled for SQL ELT optimization, the IIF() function returns incorrect results in the following cases: - IIF() function is used with LAST_DAY(), ISNULL(), or SUBSTR() functions. - IIF() function is used with IS_NUMBER() and the input value is NULL, empty string, or white spaces. - IIF() function is used with IS_SPACES() and the input value is an empty string. (February 2024)
CCON-94189	When you read Timestamp values from a source and write to a Databricks target, the Timestamp values are preserved only up to millisecond precision of three digits in the target. (February 2024)

Issue	Description
CCON-92977	When you use an unconnected lookup and run a Databricks mapping enabled for SQL ELT optimization, the mapping fails if the IIF() function returns a Float value in the lookup query. (December 2023)
CBDM-29892	A mapping that reads from or writes decimal data types in hierarchical data fails with the following error: java.lang.RuntimeException (July 2023)

Issue	Description
CCON-70459	When you read more than 10 GB of data from Databricks, the mappings intermittently fail with the following error: [ERROR] Read from Delta table failed (November 2023) Databricks ticket number: 2310230030003014