Structure Parser Transformation
The Structure Parser transforms your input data into a user defined structured format based on an Intelligent Structure model. You can use the Structure Parser transformation to analyze data such as log files, clickstreams, JSON files, and other structure formats.
The Intelligent Structure is created based on a sample of your input data.
To create an Intelligent Structure use Intelligent Structure Discovery. Intelligent Structure Discovery determines the underlying structure of a sample data file and creates a model of the structure.
You can refine the Intelligent Structure model and customize the structure of the output data. You can edit the nodes in the model to combine, exclude, flatten, or collapse them.
The Structure Parser can process inputs from source transformations efficiently and seamlessly based on the Intelligent Structure model that you select. When you add a Structure Parser transformation to a mapping, you associate it with the Intelligent Structure.
You can select a source transformation based on a flat file to process local input files. Or you can select a source transformation based on a Complex File Connector to stream input files in HDFS (Cloudera or HDP) or to process input from local file systems.
Before you create intelligent structures, ensure that you have activated the relevant licenses for Intelligent Structure Discovery and the Structure Discovery Package.