Hadoop Files Connector > Mappings and Mapping Tasks with Hadoop Files > Hadoop Files Targets in Mappings
  

Hadoop Files Targets in Mappings

To write data to a complex file, configure a Hadoop Files object as the Target transformation in a mapping. You can configure a Target transformation to represent a single Hadoop Files target.
When you use an Hadoop Files target object, select an Hadoop Files object as the target.
The following table describes the Hadoop Files target properties that you can configure in a Target transformation:
Target Property
Description
Connection
Name of the target connection or create a connection parameter.
If you choose to create a parameter for the connection, provide the connection type as Toolkit Application.
Target Type
Type of target object. Select Single Object or Parameter.
Object
Select the file to which you want to write data. Though selecting a target object is mandatory, the agent ignores this object. The agent processes the target object specified in File Directory and File Name in advanced target properties.
Parameter
The parameter for the target object. Create or select the parameter for the target object.
Note: The parameter property appears if you select parameter as the target type.
Operation
Select the target operation. You can select insert, update, upsert, delete, or data driven in an complex file target.
The following table describes the Hadoop Files target advanced properties that you can configure in a Target transformation:
Advanced Property
Description
File Directory
Optional. The directory location of one or more output files. Maximum length is 255 characters. If you do not specify a directory location, the output files are created at the location specified in the connection.
If the directory is in HDFS, enter the path without the node URI. For example, /user/lib/testdir specifies the location of a directory in HDFS. The path must not contain more than 512 characters.
If the file or directory is in the local system, enter the fully qualified path. For example, /user/testdir specifies the location of a directory in the local system.
File Name
Optional. Renames the output file. The file name is not applicable when you read or write multiple complex files.
File Format
File format. Default is Binary.
Compression Format
Optional. Compression format of the source files. The compression format for binary files. Select one of the following options:
  • - AUTO
  • - DEFLATE
  • - gzip
  • - bzip2
Select AUTO to detect the compression format based on the source file extension.
Success File Directory
Directory for the success file. Specify a directory path that is available on each Secure Agent machine in the runtime environment. By default, Data Integration writes the success file to the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/success
Error File Directory
Directory for the error file. Specify a directory path that is available on each Secure Agent machine in the runtime environment. By default, Data Integration writes the error file to the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/error
Forward Rejected Rows
Determines whether the transformation passes rejected rows to the next transformation or drops rejected rows. By default, the mapping task forwards rejected rows to the next transformation.