Property | Description |
---|---|
Connection | Name of the target connection. You can select an existing connection, create a new connection, or define parameter values for the target connection property. |
Target Type | Type of the target object. Select Single Object or Parameter. |
Object | Name of the target object. You can select an existing object. The target name can contain alphanumeric characters. You can use only a period (.), an underscore (_), an at the rate sign (@), a dollar sign ($), and a percentage sign (%) special characters in the file name. You can use parameters defined in a parameter file in the target name. |
Parameter | A parameter file where you define values that you want to update without having to edit the task. The Parameter property appears only if you select parameter as the target type. Select an existing parameter for the target object, or click New Parameter to define a new parameter for the target object. If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the advanced session properties. |
Operation | The target operation. Select one of the following operations:
Select Data Driven if you want to create a mapping to capture changed data from a CDC source. |
Data Driven Condition | Appears only when you select Data Driven as the operation type. Defines expressions to flag rows for an insert, update, or delete operation. Specify the data driven condition for non-CDC sources. For CDC sources, leave the field empty as the rows in the CDC source tables are already marked with the operation types. |
Update Columns | The primary key column to update, upsert, or delete data in an Oracle Autonomous Database target. This field is not required if the target table already has a primary key. If you do not specify a primary key column, the mapping considers the target column that you configured as the primary key column to update, upsert, or delete data. |
Create Target | Creates a new target. When you create a new target, enter a value of the following fields:
|
Property | Description |
---|---|
Bucket Name | The Oracle Cloud Object Storage bucket name that contains the objects. |
Local Staging Directory Path | Path of the local staging directory to store temporary files. Ensure that the user has write permissions on the directory. In addition, ensure that there is sufficient space to enable staging of the entire file. Default staging directory is the /temp directory on the machine that hosts the Secure Agent. |
Truncate Table | Truncates the target table before loading data to the target. Default is disabled. |
COPY_DATA Command Options | The options to provide in the COPY_DATA command when loading the data from Oracle Cloud Object Storage to Oracle Autonomous Database. For example, ignoremissingcolumns : true |
Schema Name | Overrides the schema name of the target object. |
Table Name | Overrides the table name configured in the target object and uses the specified table name to write data at runtime. |
Pre SQL | SQL statement that you want to run before writing data to the target. For example, if you want to select records from the database before you write the records into the table, specify the following pre-SQL statement: SELECT * FROM 'api-project-80697026669.EMPLOYEE.RegionNation' LIMIT 1000 |
Post SQL | SQL statement that you want to run after writing the data into the target. For example, if you want to update records in a table after you write the records into the target table, specify the following post-SQL statement: UPDATE [api-project-80697026669.EMPLOYEE.PERSONS_TGT_DEL] SET phoneNumber.number =1000011, phoneNumber.areaCode=100 where fullname='John Doe' |
Override Update Query | Overrides the default update query that the Secure Agent generates for the update operation with the update query that you specify. |
Batch Size | The number of rows to load in a batch. The default value is 2,000,000. |
Number of files per batch | The number of files in a batch. The default value is 20. |
Forward Rejected Rows | Determines whether the transformation passes rejected rows to the next transformation or drops rejected rows. By default, the agent forwards rejected rows to the next transformation. |