Cloud Integration Hub stores topic data and files in a publication repository, according to the type of publication and subscription tasks that you need to run.
The publication repository stores the data or files for a short intermediate period after the data or files are consumed by all subscribers.
Cloud Integration Hub stores the data and files in the publication repository in the following ways:
•For each publication instance, the retention period for consumed data or files starts if all the subscribers have either successfully consumed or discarded the data or files. That is, after all the events that are associated with the publication instance are either in a Complete or in a Discarded event status. If all the subscribers consume or discard the data or files, Cloud Integration Hub stores the consumed data or files in the publication repository until the retention period for consumed data or files expires, and then deletes the consumed data or files from the publication repository.
•Cloud Integration Hub stores unconsumed data or files in the publication repository until the retention period for unconsumed data or files expires, and then deletes the unconsumed data or files from the publication repository.
Hosted and private publication repositories
Choose to use a hosted or a private publication repository based on the functionality that your organization requires.
Hosted publication repository
Cloud Integration Hub hosts and manages the publication repository on Informatica Intelligent Cloud Services Hosting Services. Storage usage of the repository shows on the Cloud Integration Hub home page. Use a hosted publication repository to host a relational database. If you use an on-premises Secure Agent, you can use the hosted publication repository to host a file store publication repository.
Note: Only Amazon Web Services and Azure NTT pods support the hosted publication repository.
Private publication repository
Use your own, private repository. A private publication repository can reside on-premises or on the organization's private cloud. You can use a private publication repository to host a relational database. If the repository resides on-premises, you can use it to host a file store publication repository. For more information about setting up a private publication repository, see Set up a private publication repository.
The following table describes some of the differences in functionality between hosted and private publication repositories:
Functionality
Description
Hosted
Private
Cloud Integration Hub processor license
License required to access Cloud Integration Hub processor
Not required
Required
Data encryption
Process of encrypting data
Enabled
Not applicable
Staging database type
Type of database used for data processing operations
Not applicable
User choice
Zero downtime
Environment that ensures uninterrupted access to data
Enabled
Enabled for publications and subscriptions that trigger a Data Integration task
Secure Agent hosted by Informatica Intelligent Cloud Services
Accessible
Not applicable
Hosted publication repository size specifications
If you use a hosted publication repository when you create topic tables, verify that they don't exceed the maximum allowed row and storage sizes. If topic tables exceed the maximum allowed row or storage size on a hosted publication repository, topic table creation fails.
Maximum row size
Row size is the total length of all the columns in a topic table and is dependent on the character set.
The maximum allowed row size for a topic table is 8,000 bytes.
Maximum storage size
The storage requirements for individual columns determine how many columns fit within the maximum storage size for a topic table.
The maximum allowed storage size for a topic table row is 64,000 bytes, and the total allowed storage size is 25 GB.
Refer to the following table for the row and storage sizes that the columns occupy, based on their data type:
Data Type
Row Size in Bytes
Storage Size in Bytes
String, precision lower than or equal to 85
For data that contains ASCII characters: Precision + 1
For data that contains Unicode characters: (Precision × 3) + 2
(Precision × 3) + 2
String, precision higher than 85
22
(Precision × 3) + 2
Decimal
20
20
Double
8
8
INT32
4
4
INT64
8
8
Text
22
12
Date time
8
8
An encrypted column in a topic table occupies a row size of 22 bytes and a storage size of 12 bytes.
For example, if a topic table contains 100 columns of data type string with a precision of 80, then it exceeds the maximum allowed row size of 8,000 bytes. If a topic table contains 84 columns of data type string with a precision of 255, then it exceeds the allowed storage size of 64,000 bytes.
Refer to the following table for the row sizes and storage sizes that the mandatory topic table fields occupy:
Field
Row Size in Bytes
Storage Size in Bytes
PUBLICATION_DATE_FIELD_TYPE
8
8
PUBLICATION_INSTANCE_ID
20
20
The maximum allowed response size for API-based subscriptions is 5 MB.
Relational and file store publication repositories
You can use a relational publication repository to store relational data. If you use an on-premises publication repository, you can also use a file store publication repository to store files as-is.
Relational publication repository
Cloud Integration Hub stores relational data for the subscribers to consume in a relational publication repository. Use a relational publication repository if you use publications and subscriptions that run Data Integration tasks or publications and subscriptions that publish data with an API. You can use a relational publication repository on a hosted repository.
File store publication repository
Cloud Integration Hub stores files as-is for the subscribers to consume in a file store publication repository. Use a file store publication repository if you use publications and subscriptions that run file ingestion tasks. You can use a file store publication repository with an on-premises Secure Agent or a Secure Agent installed in a cloud environment. However, the file store publication repository location must be accessible by the Secure Agent. To use a file store publication repository, your organization must have a valid Mass Ingestion Files license. For more information, contact Informatica Global Customer Support.