Complex File Connector Guide > Complex File Connections > Complex File Connection Properties
  

Complex File Connection Properties

When you set up a complex file connection, you must configure the connection properties.
The following table describes the complex file connection properties:
Connection Property
Description
Connection Name
Name of the complex file connection.
Description
Description of the connection. The description cannot exceed 765 characters.
Type
Type of connection. Select complex file.
Runtime Environment
The name of the runtime environment where you want to run the tasks.
User Name
Required to read data from HDFS. Enter a user name that has access to the single-node HDFS location to read data from or write data to.
NameNode URI
The URI to access HDFS.
Use the following format to specify the name node URI in Cloudera, Amazon EMR, and Hortonworks distributions:
hdfs://<namenode>:<port>
Where
  • - <namenode> is the host name or IP address of the name node.
  • - <port> is the port that the name node listens for remote procedure calls (RPC).
Specify either the name node URI or the local path. Do not specify the name node URI if you want to read data from or write data to a local file system path.
Local Path
A local file system path to read data from or write data to. Do not specify local path if you want to read data from or write data to HDFS. Read the following conditions to specify the local path:
  • - You must enter 'NA' in local path if you specify the name node URI. If the local path does not contain 'NA', the name node URI does not work.
  • - If you specify the name node URI and local path, the local path takes the preference. The connection uses the local path to run all tasks.
  • - If you leave the local path blank, the agent configures the root directory (/) in the connection. The connection uses the local path to run all tasks.
Hadoop Distribution
Hadoop distribution name. Enter CLOUDERA, EMR, or HDP (Hortonworks Data Platform) based on the HDFS instance you want to use for the connection.