Property | Description |
---|---|
Connection | Name of the source connection. You can select an existing connection, create a new connection, or define parameter values for the source connection property. Note: You can switch between a non-parameterized and a parameterized Snowflake Data Cloud connection. The advanced property values are retained during the switch. If you want to overwrite the source connection properties at runtime, select the Allow parameter to be overridden at run time option. Specify the parameter file directory and name in the advanced session properties. |
Source Type | Type of the source object. Select Single Object, Multiple Objects, Query, or Parameter. |
Parameter | A parameter file where you define values that you want to update without having to edit the task. Select an existing parameter for the source object, or click New Parameter to define a new parameter for the source object. The Parameter property appears only if you select parameter as the source type. If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter. When the task runs, it uses the parameters from the file that you specify in the task advanced session properties. |
Object | The source object for the task. Select the source object for a single source. When you select the multiple source option, you can add multiple source objects and configure a relationship between them. |
Filter | Filters records based on the filter condition. You can specify a simple filter or an advanced filter. |
Sort | Sorts records based on the conditions you specify. You can specify the following sort conditions:
|
Select Distinct Rows Only1 | Extracts distinct rows from the source table. Note: If you select the source type as query or you specify the SQL query property, the Select Distinct option is ignored |
1Doesn't apply to mappings in advanced mode. |
Advanced Property | Description |
---|---|
Database | Overrides the database specified in the connection. |
Schema | Overrides the schema specified in the connection. |
Warehouse | Overrides the Snowflake warehouse name specified in the connection. |
Role | Overrides the Snowflake role assigned to user you specified in the connection. The warehouse name in the mapping overrides the warehouse name you specify in the connection. Even though you provide an incorrect warehouse name in the connection properties, the connection is successful. However, before you run the mapping, ensure that you specify the correct warehouse name in the mapping properties. |
Pre SQL | The pre-SQL command to run on the Snowflake source table before the agent reads the data. For example, if you want to update records in the database before you read the records from the table, specify a pre-SQL statement. The query must include a fully qualified table name. You can specify multiple pre-SQL commands, each separated with a semicolon. |
Post SQL | The post-SQL command to run on the Snowflake table after the agent completes the read operation. For example, if you want to delete some records after the latest records are loaded, specify a post-SQL statement. The query must include a fully qualified table name. You can specify multiple post-SQL commands, each separated with a semicolon. |
Table Name | Overrides the table name of the imported Snowflake source table. |
SQL Override | The SQL statement to override the default query used to read data from the Snowflake source. |
Tracing Level | Determines the amount of detail that appears in the log file. You can select Terse, Normal, Verbose Initialization, or Verbose Data. Default value is Normal. |