Processing Input from a Complex File Connecter

The Structure Parser can process local file input or HDFS input when you add a Complex File Connector as the source transformation. For example, the Structure Parser can process big data input from a Complex File Connector in streaming mode in a Hadoop environment.

You can create a Complex File Connector with a Hortonworks Data Platform or Cloudera connection to provide input to a Structure Parser transformation. For more information about the Complex File Connector, see the Informatica Cloud Complex File Connector User Guide.

The Complex File Connector can process a single file or an entire directory. When the Complex File Connector processes a directory, it processes the files recursively.

To ensure that the Structure Parser can process the Complex File Connector output, in the Structure Parser transformation define the Field Mapping settings correctly. Map the Data and File Path fields in the Incoming Field panel to the Data and File Path fields in the Structure Parser Input Fields panel. To do so, you can automatically or manually map the fields.