Complete Upgrade Tasks
If you upgraded the Informatica platform or applied the hotfix, you need to perform some additional tasks within the Informatica domain.
Based on the version that you upgraded from, perform the following tasks:
- Update the hadoopEnv.properties file.
- Applies to all upgrades. The 10.1.1 HotFix 1 hadoopEnv.properties file contains additional properties. You need to manually update it to include customized configuration from previous versions.
- Complete connection upgrades.
- Applies to upgrades from 9.6.1 or any 9.6.1 hotfix. You need to generate Hadoop connections from the Hive connection and update parameter files.
- Update connection properties.
- Applies to any upgrade. If you did not create connections when you ran the Hadoop Configuration Manager, you must update values for connection properties that changed.
- Replace connections.
- Applies to any upgrade. If you created connections when you ran the Hadoop Configuration Manager, you need to replace connections in mappings with the new connections.
Update the hadoopEnv.properties File
When you run the Informatica upgrade or apply the hotfix on a machine that hosts the Data Integration Service, the installer creates a new hadoopEnv.properties file and backs up the existing configuration file.
You need to edit the version 10.1.1 HotFix 1 hadoopEnv.properties file to include any manual configuration that you performed in the previous version for the corresponding distribution.
If you applied the hotfix, you can find the backup hadoopEnv.properties file in the following location:
<Informatica installation directory>/BACK_FROM_HF1/services/shared/hadoop/<Hadoop distribution name>_<version>/infaConf
If you upgraded from a previous version, you can find the backup hadoopEnv.properties file in the following location:
<Previous Informatica installation directory>/services/shared/hadoop/<Hadoop distribution name>_<version>/infaConf
You can find the 10.1.1 HotFix 1 hadoopEnv.properties file in the following location:
<Informatica installation directory>/services/shared/hadoop/<Hadoop distribution name>_<version>/infaConf
Complete Connection Upgrade
Effective in version 10.0, Big Data Management requires a Hadoop connection to run mappings on the Hadoop cluster. If you upgraded from 9.6.1 or any 9.6.1 hotfix, you must generate Hadoop connections from Hive connections that are enabled to run mappings in the Hadoop environment.
The upgrade process generates a connection name for the Hadoop connection and replaces the connection name in the mappings. It does not create the physical connection object. When the upgrade is complete, you must run a command to generate the connection. Generate Hadoop connections from Hive connections if the following conditions are true:
- •You upgraded from 9.6.1 or any 9.6.1 hotfix.
- •The Hive connections are configured to run mappings in the Hadoop environment.
Complete the following tasks to upgrade connections:
- 1. Run infacmd isp generateHadoopConnectionFromHiveConnection to generate a Hadoop connection from a Hive connection that is configured to run in the Hadoop environment.
The command renames the connection as follows: "Autogen_<Hive connection name>." If the renamed connection exceeds the 128 character limit, the command fails.
- 2. If the command fails, complete the following tasks:
- a. Rename the connection to meet the character limit and run the command again.
- b. Run infacmd dis replaceMappingHadoopRuntimeConnections to replace connections associated with mappings that are deployed in applications.
- c. Run infacmd mrs replaceMappingHadoopRuntimeConnections to replace connections associated with mappings that you run from the Developer tool.
- 3. If the Hive connection was parameterized, you must update the connection names in the parameter file. Verify that the Hive sources, Hive targets, and the Hive engine parameters are updated with the correct connection name.
- 4. If any properties changed in the cluster, such as host names, URIs, or port numbers, you must update the properties in the connections.
For information about the infacmd commands, see the Informatica Command Reference.
Update Connection Properties
If you upgraded from version 10.0 or later, and you did not create connections when you ran the Hadoop Configuration Manager, you need to verify connection properties.
Review the Hadoop, Hive, HDFS, and HBase connections that you created in a previous release to update the values for connection properties. For example, if you added nodes to the cluster or if you updated the distribution version, you might need to verify host names, URIs, or port numbers for some of the properties.
Replace the Connections
If you created connections when you ran the Hadoop Configuration Manager, you need to replace connections in mappings with the new connections.
The method that you use to replace connections in mappings depends on the type of connection.
- Hadoop connection
- If you created a Hadoop connection when you ran the Hadoop Configuration Manager, run the following commands:
- - infacmd dis replaceMappingHadoopRuntimeConnections. Replaces connections associated with mappings that are deployed in applications.
- - infacmd mrs replaceMappingHadoopRuntimeConnections. Replaces connections associated with mappings that you run from the Developer tool.
- For information about the infacmd commands, see the Informatica Command Reference.
- Hive, HDFS, or HBase connection
- If you created a Hive, HDFS, or HBase connection when you ran the Hadoop Configuration Manager, you must replace the connections manually.