Data Integration uses complex files in mapping tasks with Hadoop Files V2 Connector.
Data Integration uses the following data types in mappings and mapping tasks with complex file:
Complex file native data types
Complex native data types appear in the Source and the Target transformations when you choose to edit metadata for the fields.
Transformation data types
Set of data types that appear in the transformations. They are internal data types based on ANSI SQL-92 generic data types, which the Secure Agent uses to move data across platforms. Transformation data types appear in all transformations in a mappings and mapping tasks.
When Data Integration reads source data, it converts the native data types to the comparable transformation data types before transforming the data. When Data Integration writes to a target, it converts the transformation data types to the comparable native data types.
The following table lists the complex file data types that Data Integration supports and the corresponding transformation data types: