Workflow Management

Creating a Data Integration Hub Workflow

1. 1. Define general workflow parameters.
2. 2. If the workflow contains user-defined parameters, optionally, customize the parameters.
3. 3. Optionally, add event attributes to the workflow.
4. 4. Optionally, define workflow permissions.

Step 1. Define General Workflow Properties

1. On the Navigator, click Hub Management > Workflows > New Workflow.
2. Enter the workflow name. The name can contain up to 64 characters and can include spaces and special characters.
3. Optionally, enter a description of the workflow.
4. Select the type of processor to run the workflow. You can select one of the following processor types:
• - Select Data Engineering Integration Mapping to associate the Data Integration Hub workflow with a Data Engineering Integration mapping. The mapping runs once and stops after completion. You can assign Data Engineering Integration mappings to custom batch publications that publish big data from on-premises applications to Hadoop-based topics, and to custom batch subscriptions that consume big data from Hadoop-based topics into on-premises applications.
• - Select Data Engineering Integration Workflow to associate the Data Integration Hub workflow with a Data Engineering Integration workflow. You can assign Data Engineering Integration workflows to custom batch publications that publish big data from on-premises applications to Hadoop-based topics, and to custom batch subscriptions that consume big data from Hadoop-based topics into on-premises applications.
Note: Data Engineering Integration Workflow supports publication and subscription usage only.
• - Select Data Engineering Streaming Real-time Mapping to associate the Data Integration Hub workflow with a Data Engineering Streaming mapping. The mapping runs continuously and reads from streaming sources. You can assign Data Engineering Streaming mappings to custom multi-latency publications that publish big data streams from on-premises applications to Hadoop-based topics.
• - Select Data Quality Mapping to associate the Data Integration Hub workflow with a Data Engineering Quality mapping. The mapping runs once and stops after completion. You can assign Data Engineering Quality mappings to custom publications that publish from on-premises applications to database- or file-based topics and to custom subscriptions that consume data from database- or file-based topics into on-premises applications.
• - Select Data Quality Workflow to associate the Data Integration Hub workflow with a Data Engineering Quality workflow. The workflow runs once and stops after completion. You can assign Data Engineering Quality workflow to custom publications that publish from on-premises applications to database- or file-based topics and to custom subscriptions that consume data from database- or file-based topics into on-premises applications.
Note: Data Engineering Quality Workflow supports publication and subscription usage only.
• - Select PowerCenter Batch Workflow to associate the Data Integration Hub workflow with a PowerCenter batch workflow. A PowerCenter batch workflow reads from a file, database, or another source. The workflow runs once and stops after completion. You can assign PowerCenter batch workflows to custom publications that publish from on-premises applications to database- or file-based topics, to custom subscriptions that consume data from database- or file-based topics into on-premises applications, to publication pre-processes, to subscription post-processes, and to event monitoring rules that invoke a PowerCenter workflow.
• - Select PowerCenter Real-time Workflow to associate the Data Integration Hub workflow with a real-time workflow. A PowerCenter real-time workflow runs continuously and reads from real-time sources. You can assign PowerCenter real-time workflows to custom publications that publish from on-premises applications to database- or file-based topics. Use a real-time workflow to read data from real-time sources and write the data continuously to Data Integration Hub. For example, use it for data that is published through web-service providers or Java Message Service (JMS) queues. When publishing through a real-time workflow, you can group the published data into single publications at predefined time intervals.
5. Select the type of process to use the Data Integration Hub workflow for. Select one of the following options:
• - Publication Pre-Processing. Runs a publication pre-process.
• - Publication. Runs a publication process.
• - Subscription. Runs a subscription process.
• - Subscription Post-Processing. Runs a subscription post-process.
• - Monitoring rule. Runs the workflow when publication or subscription events are in a defined status, as defined in the event monitoring rule.
6. Select the workflow or mapping to associate with the Data Integration Hub workflow. Your selection depends on the type of workflow or mapping that you select in Processor Type:
• - When the mapping type is Data Engineering Integration mapping, the Add a Data Engineering Integration Mapping dialog box shows. To show all the Data Engineering Integration mappings that are deployed in the Data Integration Service for Hadoop environment, click Show All. To search for a mapping by application name, enter a string in the Application name text box and then click Search. Select a mapping and then click Add.
• - When the mapping type is Data Engineering Streaming Real-time mapping, the Add a Data Engineering Streaming Real-time Mapping dialog box shows. To show all the Data Engineering Streaming mappings that are deployed in the Data Integration Service for Hadoop environment, click Show All. To search for a mapping by application name, enter a string in the Application name text box and then click Search. Select a mapping and then click Add.
• - When the mapping type is Data Engineering Quality mapping, the Add an Data Engineering Quality Mapping dialog box shows. To show all mappings that are deployed in the Data Integration Service for native environment, click Show All. To search for a mapping by application name, enter a string in the Application name text box and then click Search. Select a mapping and then click Add.
• - When the mapping type is a PowerCenter workflow, either a batch workflow or a real-time workflow, the Add a PowerCenter Workflow dialog box shows. Select one of the following options:
• ▪ Select a workflow from the PowerCenter repository. Select a PowerCenter workflow that you saved in the PowerCenter repository and then click Add. To show all workflows in the repository, click Show All. To search for a workflow by name, enter a string in the Folder Name text box and then click Search.
• ▪ Select a workflow definition file (XML). Select an XML PowerCenter workflow definition file that you exported from the PowerCenter repository and then click Add. To select a file, click the browse button, browse to the location of the required file, select the file, and then click Upload.
7. If you do not want to define workflow parameters, event attributes, or permissions, click Save.

Step 2. Customize Workflow Parameters

1. Click the Workflow Parameters tab.
If the workflow or mapping that is associated with the Data Integration Hub workflow contains user-defined parameters, the Preview pane displays the default view of the workflow parameter list.
Note: Do not edit parameter values on the Preview pane.
2. Click Designer.
The Designer pane displays the parameter list in alphabetic order.
3. To arrange the parameters and groups, drag the element or group you want to arrange.
4. To edit parameter values and to change the behavior and appearance of a parameter element, click the parameter and click Actions > Edit.
The Details dialog box appears.
5. Change the properties for the parameter and click Save.
6. To add a group, click the Actions menu and choose to add a tab, column, header, or disclosure.
7. To preview the customized form, click Preview and verify the appearance of the form and any field dependencies you defined.
8. If you do not want to define event attributes or permissions for the workflow, click Save.

Step 3. Add Event Attributes to the Workflow

1. Click the Event Attributes tab.
2. In the Available Attribute Keys list select the attributes to export and click the Select icon. You can select a single attribute or multiple attributes.
The attributes you selected appear in the Selected Attribute Keys list.
3. If you do not want to define permissions for the workflow, click Save.

Step 4. Define Workflow Permissions

1. Click the Permissions tab.
2. In the Available Categories list select the categories to add to the workflow and click the Select icon. You can select a single category or multiple categories.
The categories you selected appear in the Selected Categories list.
3. Click Save.

Editing a Data Integration Hub Workflow

1. In the Navigator, click Hub Management > Workflows.
The Workflows page appears.
2. Click the Edit icon next to the workflow and update workflow properties as required.
3. Click Save.

Deleting a Data Integration Hub Workflow

1. In the Navigator, click Hub Management > Workflows.
The Workflows page appears.
2. Click the Delete icon next to the workflow and confirm the deletion.