Introduction to Microsoft Azure Data Lake Storage Gen2 Connector
Microsoft Azure Data Lake Storage Gen2 Connector example
Microsoft Azure Data Lake Storage Gen2 Connector assets
File formats
Connections for Microsoft Azure Data Lake Storage Gen2
Prepare for authentication
Managed identity authentication
Connect to Microsoft Azure Data Lake Storage Gen2
Before you begin
Connection details
Authentication types
Related links
Proxy server settings
Bypass the proxy server
Mappings for Microsoft Azure Data Lake Storage Gen2
Microsoft Azure Data Lake Storage Gen2 sources in mappings
Directory source in Microsoft Azure Data Lake Storage Gen2 sources
Wildcard characters
Reading files from subdirectories
Incrementally loading files
SQL ELT optimization
Microsoft Azure Data Lake Storage Gen2 targets in mappings
Specifying a target
Target time stamps
Target partitioning
File formatting options
Rules and guidelines for Delta file format
Rules and guidelines for Document file format
Fixed-width file formats
FileName field
Reading source objects path
Writing to target objects
Rules and guidelines for FileName field
Directory-level partitioning
Rules and guidelines for reading from and writing to a partition folder
Parameterization
Mappings in advanced mode example
Rules and guidelines for mappings
Migrating a mapping
Use the same object path for the migrated mapping
Use a different object path for the migrated mapping
Migration options
General rules and guidelines
Data type reference
Flat file data types and transformation data types
Avro data types and transformation data types
JSON data types and transformation data types
ORC data types and transformation data types
Parquet data types and transformation data types
Delta data types and transformation data types
Troubleshooting
Troubleshooting a mapping
Troubleshooting a mapping in advanced mode
Introduction to Microsoft Azure Data Lake Storage Gen2 Connector
Troubleshooting a mapping in advanced mode
CDI_GEN2_MSI_AUTH
MSAZURE_ADLSGEN2_CONN
MSAZURE_ADLSGEN2_CONN-CONN_NAME
MSAZURE_ADLSGEN2_CONN-CONN_DESC
MSAZURE_ADLSGEN2_CONN-CONN_TYPE
MSAZURE_ADLSGEN2_CONN-AGENTGROUPID
MSAZURE_ADLSGEN2_CONN-ACCOUNTNAME
MSAZURE_ADLSGEN2_CONN-FILESYSTEMNAME
MSAZURE_ADLSGEN2_CONN-DIRECTORYPATH
MSAZURE_ADLSGEN2_CONN-AUTHENTICATIONTYPE
MSAZURE_ADLSGEN2_CONN-AUTHENTICATIONTYPE-SERVICE_PRINCIPAL_AUTHENTICATION
MSAZURE_ADLSGEN2_CONN-SERVICE_PRINCIPAL_AUTHENTICATION-CLIENTID
MSAZURE_ADLSGEN2_CONN-SERVICE_PRINCIPAL_AUTHENTICATION-CLIENTSECRET
MSAZURE_ADLSGEN2_CONN-SERVICE_PRINCIPAL_AUTHENTICATION-TENANTID
MSAZURE_ADLSGEN2_CONN-ENDPOINTSUFFIX
MSAZURE_ADLSGEN2_CONN-AUTHENTICATIONTYPE-SHARED_KEY_AUTHENTICATION
MSAZURE_ADLSGEN2_CONN-SHARED_KEY_AUTHENTICATION-ACCOUNTKEY
MSAZURE_ADLSGEN2_CONN-AUTHENTICATIONTYPE-MANAGED_IDENTITY_AUTHENTICATION
MSAZURE_ADLSGEN2_CONN-MANAGED_IDENTITY_AUTHENTICATION-CLIENTID
CDI_GEN2_PROXY_SETTINGS