Cloud Integration Hub publications and subscriptions
Publications and subscriptions are entities that define how applications publish data and files to Cloud Integration Hub and how applications consume data and files from Cloud Integration Hub. Publications publish data and files to a defined topic and subscriptions subscribe to topics.
Publications and subscriptions control the data and file flow and the schedule of data and file publication or data and file consumption. An application can be a publisher and a subscriber. Multiple applications can publish to the same topic. Multiple applications can consume data or files from the same topic.
Publications and subscriptions can publish from and subscribe to any type of source and target that Informatica Intelligent Cloud Services supports. You can publish from and subscribe to different sources of data and files. Because the publishing process and the consuming process are completely decoupled, the publishing source and the consuming target do not have to be of the same data or file type. For example, you can publish data from a file and consume it into a database.
Publications and subscriptions can publish and consume data or files by triggering a Data Integration task, by triggering a file ingestion task, or with an API. For publications and subscriptions that trigger a Data Integration task, you create the tasks in Data Integration. You then select a Data Integration task when you create the publication or subscription in Cloud Integration Hub. For publications and subscriptions that trigger a file ingestion task, you create the tasks in Mass Ingestion. You then select a file ingestion task when you create the publication or subscription in Cloud Integration Hub. For publications and subscriptions that are triggered by an API, you run the API manually.
Publication and Subscription process
The publication process starts on the schedule that you define in the publication, when an external process triggers the publication, or when you manually run the publication.
When data transfer is complete, the topic data set is ready for subscribers. The subscription process starts when one of the following conditions exist, based on the configuration of data consumption in the subscriptions:
•When data is published to the topic.
•When all publishers that publish to the topic finish publishing.
If the topic to which the data is published has subscribers, Cloud Integration Hub triggers a Cloud Integration Hub subscription workflow for each subscriber, to consume the data.
Cloud Integration Hub generates events to track the progress of the publication and subscription process. When an application publishes data, Cloud Integration Hub creates a parent publication event. When the publication process ends and the published data is ready to consume, Cloud Integration Hub generates a child event for each subscription.
The events change status as the publication and subscription process progresses, and reach a completed status after the process ends successfully. You also use events to monitor and troubleshoot issues that might occur during the process.
During the publication or the subscription process, Cloud Integration Hub communicates with Informatica Intelligent Cloud Services, going through the following stages:
•When a cloud application publishes a data set, the Cloud Integration Hub server triggers the Data Integration task that is defined for the publication through an Informatica Intelligent Cloud Services REST API.
•For cloud publications, the target is defined using a Cloud Integration Hub cloud connector. The publication process uses the connector to write the data to Cloud Integration Hub.
•If the topic to which the data is published has subscribers, Cloud Integration Hub triggers the subscription workflows to consume the data.
•For cloud subscriptions, the source is defined using a Cloud Integration Hub cloud connector. The subscription process uses the connector to read data from Cloud Integration Hub.
•Cloud Integration Hub monitors the task for processing status.