To configure a data transfer task, perform the following steps:
1Define the data transfer task.
2Configure the source.
3Optionally, configure a second source to use as a lookup source.
4Configure the target.
5Configure field mappings.
6Configure runtime options.
As you work through the data transfer task wizard, you can click Save to save your work at any time. Use the Validation panel to validate the task. When you have completed the wizard, click Exit to close the task wizard.
Defining the data transfer task
1To create a new data transfer task click New > Tasks. Select Data Transfer Task and click Create.
To edit a data transfer task, on the Explore page, navigate to the data transfer task. In the row that contains the task, click Actions and select Edit.
2Configure the following properties:
Property
Description
Name
Name of the data transfer task.
Location
Project and folder in which the task resides.
Description
Description of the data transfer task.
Maximum length is 4000 characters.
Runtime Environment
Runtime environment that contains the Secure Agent to run the task.
3Click Next.
Configuring the source
You can configure a single object or custom query as the source of a Data Integration task.
1On the Source page, select the source connection.
To create a connection, click New. To edit a connection, click View, and the in View Connection dialog box, click Edit.
2Select the source type. To use a single source, select Single. To use a custom query, select Query.
You can use a custom query when you use a database connection.
3Select the source object or enter the query.
4For file sources, configure formatting options.
5Configure data filters.
6Configure sort conditions.
Not all connectors support sorting. The Sort area appears if the source connector supports sorting.
7If preview data does not appear automatically, expand the Data Preview area to preview the source data.
8Click Next.
Configuring a second source
Optionally, configure a second source to use as a lookup source.
1On the Second Source page, select Yes to add a second source to the task.
If you do not want to configure a second source, select No.
2If you add a second source, perform the following steps to configure the source:
aIn the Source Details area, select Augment Data with Lookup.
bSelect the source connection and source object.
To create a connection, click New. To edit a connection, click View, and the in View Connection dialog box, click Edit.
cFor file sources, configure formatting options.
dIf preview data does not appear automatically, expand the Data Preview area to preview the source data.
eConfigure one or more lookup conditions.
fOptionally, configure data filters for the combined sources.
3Click Next.
Configuring the target
You can write data to a single target. You can select an existing target object or create a new object at run time. If you create a target at run time, the task operation is Insert.
1On the Target page, configure the following properties as required:
Property
Description
Connection
Select a connection.
To create a connection, click New. To edit a connection, click View, and the in View Connection dialog box, click Edit.
To configure advanced properties for the connection, click Advanced Options. Not available for all connections types.
For information about a particular connector's properties, see the help for the appropriate connector.
Object
Select a target object.
Click Select. The Select Target Object dialog box displays up to 200 objects. If the object you want to use does not display, enter a search string to reduce the number of objects that display.
Target operation
Select one of the following task operations:
- Insert
- Update
- Upsert
- Delete
- Data Driven
The operations available depend on the target connection.
Formatting Options
For flat file connections only. Select a delimiter and text qualifier. Optionally, select an escape character.
If you choose Other for the delimiter, the delimiter cannot be an alphanumeric character or a double quotation mark.
Truncate Target
Database targets with the Insert task operation only. Truncates a database target table before inserting new rows.
- True. Truncates the target table before inserting all rows.
- False. Inserts new rows without truncating the target table.
Default is False.
Enable Target Bulk Load
Select this option to write data in bulk mode. The default value is false.
2For database targets, configure update columns if necessary.
3If preview data does not appear automatically, expand the Data Preview area to preview the target data.
4Click Next.
Configuring the field mapping
Configure field mappings to define the data that the data transfer task writes to the target. Configure field mappings on the Field Mapping page.
1To match fields with the same name, click Automap > Exact Field Name. Or, to match fields with similar names, click Automap > Smart Map.
You can also select and drag the source fields to the applicable target fields.
2To configure the field expression, click the mapped field. In the Field Expression window, enter the expression you want to use and click OK.
3If you create a target at run time and want to add target fields, click Add. Configure the following field properties:
Property
Description
Name
Name of the field.
Type
The data type of the data in the column.
Precision
Total number of digits in a number. For example, the number 123.45 has a precision of 5. The precision must be greater than or equal to 1.
Scale
The number of digits to the right of the decimal point of a number. For example, the number 123.45 has a scale of 2. Scale must be greater than or equal to 0. The scale of a number must be less than its precision. The maximum scale for a numeric data type is 65535.
4Click Next.
Configuring runtime options
Configure runtime options on the Runtime Options page.
You can run a data transfer task manually or on a schedule.
1To run a data transfer task on a schedule, select Run on a schedule and then select the schedule.
Note: You must create the schedule in Administrator before you can select it in the task.
2Configure email notification options for the task.