Transformations
This section describes new features and enhancements for transformations for the Fall 2016 release.
Hierarchy Builder Transformation
You can use a Hierarchy Builder transformation in a mapping to convert relational data to an XML or JSON format.
You use an XML or JSON schema file or sample file to create a hierarchical schema that defines the expected hierarchy of the output data. The Hierarchy Builder transformation converts relational input into XML or JSON output with a hierarchy based on the hierarchical schema that you associate with the transformation.
Select the hierarchical schema as part of the output settings for the transformation. Use the field mapping editor to designate primary and foreign keys. Configure the field mapping to define which relational elements map to the hierarchical output.
For more information, see Transformations .
Hierarchy Parser Transformation
Effective in the Fall 2016 release, you can use the Hierarchy Parser transformation to transform XML or JSON input into relational output.
Previously you used an XML to Relational transformation to transform XML input into relational output.
The Hierarchy Parser can map hierarchical data to relational fields in multiple groups, or can map data in denormalized mode, so that all relational data is in one group.
For more information, see Transformations.
Lookup Transformation
The Lookup transformation adds caching properties and other runtime attributes for Toolkit Connectors.
New features include:
- •Support for Amazon Redshift runtime attributes in ODBC connections.
- •Caching properties for performance improvements.
- •Pipeline support for unconnected Source and Source Qualifier transformations.
For more information, see Transformations.
Router Transformation
The Router transformation is an active transformation you can use in a mapping to test the same input data based on multiple conditions.
You can route data to more than one downstream transformation based on the conditions, instead of creating a separate Filter transformation for each condition.
For more information, see Transformations.
Structure Parser Transformation
Effective in the Fall 2016 release, the Structure Parser can transform HDFS input in streaming mode, or any other input that the Complex File Connector provides. You use a Complex File Connector as the source transformation to provide HDFS or other input to the transformation.
The Structure Parser can process both local file input and distributed file system input. Previously, the Structure Parser did not support distributed file system input.
Effective in the Fall 2016 release, Intelligent Discovery can process JSON input. Previously, Intelligent Discovery did not process JSON files.
For more information, see Transformations.
Target Transformation Option to Create Relational Targets
You can create a new object for relational data sources in the Target transformation and parameterize the target object in the Mapping Configuration Task.
With this feature, you can override an existing object and edit target object metadata.
Web Services Transformation Support for Hierarchy
You can use a Web Services transformation that appears midstream in a mapping to build a hierarchical structure for use as part of a business service.
This allows you to extract data to separate output groups or to structure data as XML, including these options:
- •Choose relational or denormalized format.
- •Attach pass-through fields to a root group.
- •A fault group is optional
- •Create multiple groups.
Existing mappings are not impacted by the change but you can choose to update these mappings to relational format.