New Features (10.4.0.1)
Data Engineering Integration
This section describes new Data Engineering Integration features in version 10.4.0.1.
CLAIRE Recommendations and Insights
Effective in version 10.4.0.1, you can run CLAIRE analysis on individual mappings you multi-select.
You can multi-select more than one mapping, then right-click and choose Analyze to read CLAIRE insights about similarities between the selected mappings.
Previously, you could run analysis only on a project or folder.
For more information about recommendations and insights, see the Data Engineering Integration User Guide.
Hive LLAP on Hortonworks HDP 3.x
Effective in version 10.4.0.1, you can enable Hive LLAP on Hortonworks HDP 3.x clusters when you run mappings on the Spark engine.
Use Hive LLAP for faster execution of Hive queries when you read and write to Hive tables with the Spark engine. When you enable Hive LLAP, mappings also use the Hive Warehouse Connector to interact with Hive tables.
To enable Hive LLAP, configure properties in the Hadoop connection:
- •In the common properties, set the following properties:
- •In the Spark advanced properties, set the following properties:
- - spark.datasource.hive.warehouse.load.staging.dir=<HDFS temporary directory for writing to Hive tables>
- - spark.datasource.hive.warehouse.metastoreUri=<URI for the Hive metastore>
Copy the value for hive.metastore.uris from the hive_site_xml cluster configuration properties.
- - spark.hadoop.hive.zookeeper.quorum=<Zookeeper hosts used by Hive LLAP>
Copy the value for hive.zookeeper.quorum from the hive_site_xml cluster configuration properties.
Enterprise Data Catalog
This section describes the new Enterprise Data Catalog features in version 10.4.0.1.
New Resources
Effective in version 10.4.0.1, the following new resources are added in Enterprise Data Catalog:
- •Apache Kafka
- •Qlik Sense
- •MongoDB
You can extract metadata, relationship and lineage information from all the above resources. For more information, see the Informatica 10.4.0.1 Enterprise Data Catalog Scanner Configuration Guide.
PowerExchange Adapters for Informatica
This section describes new Informatica adapter features in version 10.4.0.1.
PowerExchange for Microsoft Azure Data Lake Storage Gen2
Effective in version 10.4.0.1, when you create a data object read or write operation, you can read data present in the FileName port that contains the endpoint name and source path of the file.
For more information, see the Informatica 10.4.0 PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide.