What's Changed
Enterprise Data Catalog
This section describes the changes to Enterprise Data Catalog in version 10.4.0.1.
Compact View
Effective in version 10.4.0.1, you can view transformation logic in the Compact view. Previously, you could not view transformation logic in the Compact view.
For more information, see the Informatica® 10.4.0 Enterprise Data Catalog User Guide.
Data Engineering Integration
This section describes the changes to Data Engineering Integration in version 10.4.0.1.
Data Preview on the Spark engine
Effective in version 10.4.0.1, you can use HTTPS when you preview data on the Spark engine using the Spark Jobserver.
If you enable HTTPS protocol on the Data Integration Service, the Spark Jobserver also uses HTTPS protocol. The Spark Jobserver uses the same HTTPS keystore configuration that you set in the Data Integration Service process properties in the Administrator tool.
For more information, see the Informatica® 10.4.0 Application Service Guide.
Hive Warehouse Connector and Hive LLAP
Effective in version 10.4.0.1, you can enable the Hive Warehouse Connector and Hive LLAP when you run mappings on the Spark engine. Previously, these were available for technical preview.
Use the Hive Warehouse Connector and Hive LLAP for faster execution of Hive queries when you read and write to Hive tables with the Spark engine. You can use the Hive Warehouse Connector and Hive LLAP with Hortonworks HDP 3.x and Microsoft Azure HDInsight 4.x clusters on the Spark engine.
To enable the Hive Warehouse Connector and Hive LLAP, configure the following properties in the Spark advanced properties for the Hadoop connection:
- •infaspark.useHiveWarehouseAPI=true
- •spark.datasource.hive.warehouse.load.staging.dir=<HDFS temporary directory for writing to Hive tables>
- •spark.datasource.hive.warehouse.metastoreUri=<URI for the Hive metastore>
Use the value for hive.metastore.uris from the hive_site_xml cluster configuration properties.
- •spark.hadoop.hive.llap.daemon.service.hosts=<Application name for the LLAP service>
Use the value for hive.llap.daemon.service.hosts from the hive_site_xml cluster configuration properties.
- •spark.hadoop.hive.zookeeper.quorum=<Zookeeper hosts used by Hive LLAP>
Use the value for hive.zookeeper.quorum from the hive_site_xml cluster configuration properties.
- •spark.sql.hive.hiversever2.jdbc.url=<URL for HiveServer2 Interactive.
Use the value in Ambari for HiveServer2 JDBC URL.
For more information, refer to the Data Engineering Integration 10.4.1 User Guide.
PowerExchange Adapters for Informatica
This section describes changes to Informatica adapters in version 10.4.0.1.
PowerExchange for Microsoft Azure Data Lake Storage Gen2
Effective in version 10.4.0.1, the FileName port appears for the sources and targets used in the existing 10.4.0 dynamic mappings. To run the existing dynamic mappings successfully, add transformations such as Expression to eliminate the FileName port from the source and target objects.
For more information, see the Informatica 10.4.0.PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide.