Hadoop Files Connector > Synchronization Tasks with Hadoop Files > Hadoop Files Targets in Synchronization Tasks
  

Hadoop Files Targets in Synchronization Tasks

When you configure a synchronization task to perform operations on a Hadoop Files target, you can configure the target properties.
The target properties appear on the Target page of the Synchronization Task wizard when you specify a Hadoop Files connection. The general properties display the name and description of the Hadoop Files target.
The following table describes the Hadoop Files target properties:
Property
Description
Connection
Name of the target connection.
Target Object
Select the file to which you want to write data. Though selecting a target object is mandatory, the agent ignores this object. The agent processes the target object specified in File Directory and File Name in advanced target properties.
Child Object
Not applicable.
You can also configure advanced target properties when you schedule the synchronization task. Advanced target properties appear on the Schedule page of the Synchronization Task wizard.
The following table describes the Hadoop Files advanced target properties:
Advanced Property
Description
File Directory
Optional. The directory location of one or more output files. Maximum length is 255 characters. If you do not specify a directory location, the output files are created at the location specified in the connection.
If the directory is in HDFS, enter the path without the name node URI. For example, /user/lib/testdir specifies the location of a directory in HDFS. The path must not contain more than 512 characters.
If the file or directory is in the local system, enter the fully qualified path. For example, /user/testdir specifies the location of a directory in the local system.
File Name
Optional. Renames the output file. The file name is not applicable if the source object is a directory.
File Format
File format. Default is Binary.
Compression Format
Optional. Compression format of the source files. The compression format for binary files. Select one of the following options:
  • - AUTO
  • - DEFLATE
  • - gzip
  • - bzip2
Select AUTO to detect the compression format based on the source file extension.
Success File Directory
Directory for the success file. Specify a directory path that is available on each Secure Agent machine in the runtime environment. By default, Data Integration writes the success file to the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/success
Error File Directory
Directory for the error file. Specify a directory path that is available on each Secure Agent machine in the runtime environment. By default, Data Integration writes the error file to the following directory: <Secure Agent installation directory>/apps/Data_Integration_Server/data/error