Part I: Getting Started with Snowflake Data Cloud Connector
Introduction to Snowflake Data Cloud Connector
Snowflake Data Cloud Connector assets
Connections for Snowflake Data Cloud
Prepare for authentication
Standard
Authorization code
Key pair
Client credentials
Connect to Snowflake
Before you begin
Connection details
Authentication types
Related links
JDBC URL parameters
Microsoft Azure Active Directory for external OAuth authorization
Proxy server settings
Private links to access Snowflake
Use the serverless runtime environment with key pair authentication
Part II: Data Integration with Snowflake Data Cloud Connector
Mappings for Snowflake Data Cloud
Before you begin
Verify permissions
Verify ports
Snowflake Data Cloud transformations
SQL transformation
Handling dynamic schemas
Handling dynamic schemas for mappings in advanced mode
Rules and guidelines for dynamic schema handling
Mapping example
Mappings in advanced mode example
Parameterization restrictions for mappings in advanced mode
Sources for Snowflake Data Cloud
Source properties for Snowflake Data Cloud
Source objects and operations
Key range partitioning
Overriding SQL
Targets for Snowflake Data Cloud
Target properties for Snowflake Data Cloud
Write runtime parameters
Target objects and operations
Passthrough partitioning
Specify a target
Override the update operation
Optimize the .csv file size
Configuring the batch size and the number of local staging files
Configure load properties in mappings
Configure additional runtime parameters to run mappings in advanced mode
Capturing changed data from CDC sources
Configuring a mapping task to read from a CDC source
Disabling the recovery mechanism
Viewing job statistics
Rules and guidelines for Snowflake Data Cloud target transformations
Lookups for Snowflake Data Cloud
Lookup properties for Snowflake Data Cloud
Parameterization
Multiple match restrictions
Enable lookup caching
Log uncached lookup queries
Migrating a mapping
Plan the migration
Migrate a mapping within the same path
Migrate a mapping to a different path
Migration options
Migration restrictions
Migrate mappings containing multiple source objects
Migrate mappings containing advanced filter and a table name override
Migrate mappings containing an SQL override and custom query
Part III: SQL ELT with Snowflake Data Cloud Connector
Introduction to SQL ELT
Configuring SQL ELT
Previewing SQL ELT query
Prepare for SQL ELT
Access data files in an Amazon S3 bucket
Configuring storage integration for Amazon S3
Access to data files in a Google Cloud Storage bucket
Configuring storage integration for Google Cloud Storage
Access to data files in a Microsoft Azure Data Lake Storage Gen2 container
Configuring storage integration for Microsoft Azure Data Lake Storage Gen2
Granting access to the storage locations
Verify permissions for SQL ELT
Mappings in SQL ELT mode for Snowflake Data Cloud
Sources in mappings in SQL ELT mode
Targets in mappings in SQL ELT mode
Transformations in mappings in SQL ELT mode
Functions in mappings in SQL ELT mode
Operators in mappings in SQL ELT mode
Rules and guidelines in mappings in SQL ELT mode
SQL ELT optimization for mapping tasks
SQL ELT optimization types
SQL ELT compatibility
Functions with Snowflake Data Cloud
Operators with Snowflake Data Cloud
Variables with Snowflake Data Cloud
Transformations with Snowflake Data Cloud
Aggregator transformation
Expression transformation
Hierarchy Processor transformation
Lookup transformation
Normalizer transformation
Router transformation
Sequence Generator transformation
SQL transformation
Union transformation
Update Strategy transformation
Features
Snowflake Data Cloud sources, targets, and lookups
Amazon S3 V2 source
Google Cloud Storage V2 source
Microsoft Azure Data Lake Storage Gen2 source
Creating temporary view for source overrides
Configuring target copy command options
Configuring SQL ELT optimization
Context based optimization for multiple targets
Understanding an SCD type 2 merge mapping
Pushing logic to a database with different schemas
Configuring cross-schema SQL ELT optimization
Pushing logic to different databases
Configuring cross-database SQL ELT optimization
Clean stop a SQL ELT optimization job
Verify the SQL ELT query in the session log
Troubleshooting
Data type reference
Snowflake Data Cloud and transformation data types
Semi-structured data types and transformation data types
Rules and guidelines for data types
Additional runtime configurations
Configure JVM memory requirements
Configure bulk processing
Configure logging properties
Configure the temp directory for a mapping
Optimize the staging performance of a mapping
Optimize the write operation in a CDC mapping
Upgrading to Snowflake Data Cloud Connector
Connection switching example
Properties retained after the switch
Rules and guidelines
Part I: Getting Started with Snowflake Data Cloud Connector
Rules and guidelines
CDI_SNOWFLAKE_DATA_CLOUD_PREPARE_FOR_AUTHENTICATION
DW_SNOWFLAKEV2_CONN
DW_SNOWFLAKEV2_CONN-CONN_NAME
DW_SNOWFLAKEV2_CONN-CONN_DESC
DW_SNOWFLAKEV2_CONN-CONN_TYPE
DW_SNOWFLAKEV2_CONN-AGENTGROUPID
DW_SNOWFLAKEV2_CONN-AUTHENTICATION
DW_SNOWFLAKEV2_CONN-AUTHENTICATION-STANDARD
DW_SNOWFLAKEV2_CONN-STANDARD-USER
DW_SNOWFLAKEV2_CONN-STANDARD-PASSWORD
DW_SNOWFLAKEV2_CONN-STANDARD-ACCOUNT
DW_SNOWFLAKEV2_CONN-STANDARD-WAREHOUSE
DW_SNOWFLAKEV2_CONN-STANDARD-ROLE
DW_SNOWFLAKEV2_CONN-STANDARD-ADDITIONALPARAM
DW_SNOWFLAKEV2_CONN-AUTHENTICATION-AUTHORIZATIONCODE
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-ACCOUNT
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-WAREHOUSE
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-OAUTHURL
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-ACCESSTOKENURL
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-CLIENTID
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-CLIENTSECRET
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-ACCESSTOKEN
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-ADDITIONALPARAM
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-SCOPE
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-ACCESSTOKENPARAMETERS
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-AUTHORIZATIONCODEPARAMETERS
DW_SNOWFLAKEV2_CONN-AUTHORIZATIONCODE-REFRESHTOKEN
DW_SNOWFLAKEV2_CONN-AUTHENTICATION-KEYPAIR
DW_SNOWFLAKEV2_CONN-KEYPAIR-USER
DW_SNOWFLAKEV2_CONN-KEYPAIR-ACCOUNT
DW_SNOWFLAKEV2_CONN-KEYPAIR-WAREHOUSE
DW_SNOWFLAKEV2_CONN-KEYPAIR-PRIVATEKEYFILE
DW_SNOWFLAKEV2_CONN-KEYPAIR-ADDITIONALPARAM
DW_SNOWFLAKEV2_CONN-KEYPAIR-PRIVATEKEYFILEPWD
DW_SNOWFLAKEV2_CONN-AUTHENTICATION-CLIENTCREDENTIALS
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-ACCOUNT
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-WAREHOUSE
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-ACCESSTOKENURL
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-CLIENTID
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-CLIENTSECRET
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-SCOPE
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-ACCESSTOKEN
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-ADDITIONALPARAM
DW_SNOWFLAKEV2_CONN-CLIENTCREDENTIALS-ACCESSTOKENPARAMETERS
CDI_SNOWFLAKE_DATA_CLOUD_CONFIGURE_PROXY_SETTING
CDI_SNOWFLAKE_DATA_CLOUD_CONFIGURE_PRIVATE_CONNECTVITY