Update Files on the Developer Tool
Update configuration files to enable communication and high availability between the Developer tool and the cluster.
Before you perform configuration on the Developer tool, you need to copy some configuration files to the machine that hosts the Developer tool.
- 1. Find hdfs-site.xml and yarn-site.xml on the name node of the cluster.
- 2. Copy the files to the following location on the machine that hosts the Developer tool: <Informatica installation directory>/clients/DeveloperClient/Hadoop/<Hadoop distribution><version>/conf
yarn-site.xml
Configure the following property in yarn-site.xml:
- yarn.application.classpath
- Sets the classpath for YARN applications and enables the Developer tool to read from and write to a highly available cluster.
- To identify the classpath, run the yarn classpath command. The following sample text shows a sample classpath entry:
<property>
<name>yarn.application.classpath</name>
<value>
/etc/hadoop/conf:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/
libexec/../../hadoop/lib/*:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/
hadoop/libexec/../../hadoop/.//*:/opt/cloudera/parcels/
CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../hadoop-hdfs/./:/opt/cloudera/
parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../hadoop-hdfs/lib/*:/opt/
cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../hadoophdfs/.//*:/
opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../
hadoop-yarn/lib/*:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/
libexec/../../hadoop-yarn/.//*:/opt/cloudera/parcels/CDH/lib/hadoopmapreduce/
lib/*:/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/.//*:/opt/cloudera/
parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../hadoop-yarn/.//*:/opt/
cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hadoop/libexec/../../hadoopyarn/
lib/*
</value>
</property>
developerCore.ini
Edit developerCore.ini to enable communication between the Developer tool and the Hadoop cluster. You can find developerCore.ini in the following directory: <Informatica installation directory>\clients\DeveloperClient
Add the following property:
-DINFA_HADOOP_DIST_DIR=hadoop\<distribution><version>
The change takes effect when you restart the Developer tool.