•  Introduction to Databricks Connector
  •  Databricks Connector assets
  •  External tables in Databricks
•  Connections for Databricks
  •  Staging prerequisites
  •  SQL warehouse
    •  Configure AWS staging
    •  Configure Azure staging
  •  All-purpose cluster
    •  Configure Secure Agent properties
  •  Job cluster
    •  Configure Spark parameters
    •  Configure Secure Agent properties
  •  Connect to Databricks
    •  Before you begin
    •  Connection details
    •  Authentication type
    •  Advanced settings
    •  Related links
  •  Configure proxy settings
  •  JDBC URL parameters
  •  Rules and guidelines for personal staging location
  •  Private links to access Databricks
•  Mappings for Databricks
  •  Before you begin
    •  Verify permissions
  •  Sources for Databricks
    •  Source properties for Databricks
    •  Custom query source type
    •  Key range partitioning
  •  Targets for Databricks
    •  Target properties for Databricks
    •  Create a target table at runtime
    •  Override the update operation
    •  Passthrough partitioning
    •  Determine the order of processing for multiple targets
    •  Optimize the staging performance of a mapping
  •  Lookups for Databricks
    •  Lookup properties for Databricks
    •  Enable lookup caching
  •  SQL transformation
  •  Dynamic schema handling
  •  Parameterization
  •  IDENTITY columns
  •  Mappings in advanced mode example
  •  Rules and guidelines for mappings
  •  Rules and guidelines for mappings in advanced mode
•  Migrating a mapping
  •  Plan the migration
    •  Migrate a mapping within the same path
    •  Migrate a mapping to a different path
    •  Migration options
  •  Migration restrictions
•  SQL ELT with Databricks Connector
  •  SQL ELT configuration options
    •  Create a mapping in SQL ELT mode
    •  Enable SQL ELT optimization for a mapping task
  •  SQL ELT query preview
  •  Mappings in SQL ELT mode for Databricks
    •  Sources in mappings in SQL ELT mode
    •  Targets in mappings in SQL ELT mode
    •  Transformations in mappings in SQL ELT mode
    •  Functions in mappings in SQL ELT mode
    •  Operators in mappings in SQL ELT mode
    •  Rules and guidelines in mappings in SQL ELT mode
  •  SQL ELT optimization for mapping tasks
    •  SQL ELT optimization types
    •  Read from and write to Databricks
    •  Read from Amazon S3 and write to Databricks
    •  Read from Microsoft Azure Data Lake Storage Gen2 and write to Databricks
    •  SQL ELT compatibility
    •  Configuring SQL ELT optimization
    •  Transformations with Databricks
    •  Features
    •  Configuring a custom query for the Databricks source object
    •  SQL ELT optimization for multiple targets
    •  Single commit for SQL ELT optimization
    •  Rules and guidelines for SQL ELT optimization
    •  Troubleshooting SQL ELT optimization
•  Data type reference
  •  Databricks and transformation data types

Introduction to Databricks Connector

Databricks and transformation data types

CDI_DATABRICKS_PREREQUISITES

EA_DBDELTA_CONN

EA_DBDELTA_CONN-CONN_NAME

EA_DBDELTA_CONN-CONN_DESC

EA_DBDELTA_CONN-CONN_TYPE

EA_DBDELTA_CONN-AGENTGROUPID

EA_DBDELTA_CONN-SQLENDPOINTURL

EA_DBDELTA_CONN-AUTHENTICATIONMODE

EA_DBDELTA_CONN-AUTHENTICATIONMODE-PAT

EA_DBDELTA_CONN-DBTOKEN

EA_DBDELTA_CONN-PAT-DBTOKEN

EA_DBDELTA_CONN-UNITYCATALOG

EA_DBDELTA_CONN-AUTHENTICATIONMODE-SPN

EA_DBDELTA_CONN-SPN-CLIENTID

EA_DBDELTA_CONN-SPN-CLIENTSECRET

EA_DBDELTA_CONN-DATABASE

EA_DBDELTA_CONN-JDBCDRIVERCLASSNAME

EA_DBDELTA_CONN-CLUSTERENVIRONMENT-PERSONAL_STAGING_LOCATION

EA_DBDELTA_CONN-CLUSTERENVIRONMENT

EA_DBDELTA_CONN-CLUSTERENVIRONMENT-VOLUME

EA_DBDELTA_CONN-VOLUME-VOLUMEPATH

EA_DBDELTA_CONN-DBHOSTNAME

EA_DBDELTA_CONN-DBCLUSTERID

EA_DBDELTA_CONN-DBORGID

EA_DBDELTA_CONN-MINWORKERS

EA_DBDELTA_CONN-MAXWORKERS

EA_DBDELTA_CONN-DBRUNTIMEVERSION

EA_DBDELTA_CONN-WORKERNODETYPE

EA_DBDELTA_CONN-DRIVERNODETYPE

EA_DBDELTA_CONN-INSTANCEPOOLID

EA_DBDELTA_CONN-ENABLEELASTICDISK

EA_DBDELTA_CONN-SPARKCONFIG

EA_DBDELTA_CONN-SPARKENVVAR

EA_DBDELTA_CONN-CLUSTERENVIRONMENT-AWS

EA_DBDELTA_CONN-AWS-S3AUTHENTICATIONMODE

EA_DBDELTA_CONN-AWS-S3AUTHENTICATIONMODE-IAM_ASSUME_ROLE

EA_DBDELTA_CONN-AWS-S3AUTHENTICATIONMODE-PERMANENT_IAM_CREDENTIALS

EA_DBDELTA_CONN-AWS-S3ACCESSKEY

EA_DBDELTA_CONN-AWS-S3SECRETKEY

EA_DBDELTA_CONN-AWS-S3DATABUCKET

EA_DBDELTA_CONN-AWS-S3STAGINGBUCKET

EA_DBDELTA_CONN-AWS-S3VPCENDPOINTTYPE

EA_DBDELTA_CONN-AWS-S3VPCENDPOINTTYPE-INTERFACE_ENDPOINT

EA_DBDELTA_CONN-AWS-S3VPCENDPOINTTYPE-NONE

EA_DBDELTA_CONN-INTERFACE_ENDPOINT-S3ENDPOINTDNSNAME

EA_DBDELTA_CONN-IAM_ASSUME_ROLE-S3IAMROLEARN

EA_DBDELTA_CONN-IAM_ASSUME_ROLE-S3USEEC2ROLETOASSUMEROLE

EA_DBDELTA_CONN-IAM_ASSUME_ROLE-STSVPCENDPOINTTYPE

EA_DBDELTA_CONN-IAM_ASSUME_ROLE-STSVPCENDPOINTTYPE-INTERFACE_ENDPOINT

EA_DBDELTA_CONN-IAM_ASSUME_ROLE-STSVPCENDPOINTTYPE-NONE

EA_DBDELTA_CONN-INTERFACE_ENDPOINT-STSENDPOINTDNSNAME

EA_DBDELTA_CONN-AWS-S3REGIONALENDPOINT

EA_DBDELTA_CONN-AWS-S3REGIONNAME

EA_DBDELTA_CONN-AWS-ZONEID

EA_DBDELTA_CONN-AWS-EBSVOLUMETYPE

EA_DBDELTA_CONN-AWS-EBSVOLUMECOUNT

EA_DBDELTA_CONN-AWS-EBSVOLUMESIZE

EA_DBDELTA_CONN-CLUSTERENVIRONMENT-AZURE

EA_DBDELTA_CONN-AZURE-ADLSACCOUNTNAME

EA_DBDELTA_CONN-AZURE-ADLSCLIENTID

EA_DBDELTA_CONN-AZURE-ADLSCLIENTSECRET

EA_DBDELTA_CONN-AZURE-ADLSDIRECTORYID

EA_DBDELTA_CONN-AZURE-ADLSENDPOINT

EA_DBDELTA_CONN-AZURE-ADLSDATAFILESYSTEMNAME

EA_DBDELTA_CONN-AZURE-ADLSSTAGINGFILESYSTEMNAME

CDI_DATABRICKS_PROXY

CDI_DATABRICKS_SETJDBCURL