Before You Begin
Before you develop Data Engineering Integration, Data Engineering Streaming mappings, or Data Engineering Integration workflows to use in Data Integration Hub, verify that the following conditions exist:
- •The following Data Integration Hub components are installed:
- - Data Integration Hub Hadoop Service.
- - Data Integration Hub Data Engineering Integration.
- •The topic to which to publish data and from which to consume data is configured in Data Integration Hub. The topic must be a Hadoop-based topic.
- •The following connections are configured in Data Integration Hub:
- - Connection to the publishing application.
- - Connection to the subscribing application.
- •A Hadoop connection to where to run the mappings exists in your environment. The connection must be a cluster connection, and must push mapping logic to the Hadoop cluster.
Before you develop Data Engineering Streaming mappings, copy the runtime .jar files from <DIHInstallationDir>/ powercenter/lib to the following location:
BDS_HOME/services/shared/hadoop/$Distribution/extras/spark-auxjars/