Data Engineering Integration
This section describes changes to Data Engineering Integration in version 10.4.1.
Intelligent Structure Discovery
Effective in version 10.4.1, when Intelligent Structure Discovery infers data types for Avro, Parquet and ORC files, it uses the same data types that the native connectors use, resulting in unified output across platforms.
Previously, Intelligent Structure Discovery data types inference wasn't aligned with the inference of the native connectors.
For more information, see "Intelligent structure Models" in the Data Engineering Integration 10.4.1 User Guide.