Topic properties include general information about the topic, the topic structure, and the publications and subscriptions that are associated with the topic.
The topic page includes the following areas:
•Topic Diagram. Provides a visual overview of the topic and its relations to other assets. You can perform actions on assets in the diagram. For more information, see Topic Diagram.
•General Details. General information about the topic. For more information, see General Details properties.
•Topic Structure. List of topic tables, including details about each table. You add topic tables to the topic in this area. For more information, see Topic structure properties.
•Publications. List of publications that publish data to the topic, including information about each publication. You can perform actions on existing publications and create new publications in this area. For more information, see Publications properties.
•Subscriptions. List of subscriptions that subscribe to data from the topic, including information about each subscription. You can perform actions on existing subscriptions and create new subscriptions in this area. For more information, see Subscriptions properties.
You can collapse and expand each area on the topic page.
Topic Diagram
The topic page shows the Topic Diagram. The diagram provides a visual overview of the topic and its relations to other assets, including the following assets:
•Applications that publish data to the topic
•Publications that publish the data from the applications to the topic
•Subscriptions that subscribe to data from the topic
•Applications that consume the data from the topic through the subscriptions
The following image shows a sample Topic Diagram:
When you click an asset, the properties page for the asset appears. For example, when you click a publication, the publication page appears.
When you right-click an asset, you can open it for viewing and editing. You can also run publications and subscriptions that trigger Data Integration tasks.
General Details properties
The General Details area of topic page includes the following properties:
Topic Name
Name of the topic. The name must begin with an alphabetic character or underscore and can contain only alphanumeric characters or underscores.
Description
Optional description of the topic.
Publication Repository Type
Type of publication repository where the hub stores published data or files to consume.
Choose one of the following options:
- Relational. Stores published data in a relational database. Use the relational publication repository for publications and subscriptions that run Data Integration tasks or that publish data with an API.
- File store. Stores published files as-is in a file store. Use the file store publication repository for publications and subscriptions that run file ingestion tasks.
Topic Type
Type of the topic. Topic type depends on the type of data that applications publish to the topic and has an impact on the delivery options to the subscribers to the topic.
Choose one of the following options:
- Incremental Load. The topic instance contains only the latest data changes. If you choose this topic type, verify that the data sources include delta indicators.
- Full Load. The topic contains all of the data changes that occurred after the last publication.
Prevent new publications and new subscriptions to this topic
Prevent new publications from publishing to the topic and prevent new subscriptions from subscribing to the topic. For example, when you plan to delete the topic. The topic is not available for selection when creating publications and subscriptions.
Existing publications can publish data to the topic and existing subscriptions can consume data from the topic.
Retention period for consumed data
Determines how long Cloud Integration Hub retains consumed data in the publication repository before it deletes the data. The retention period for consumed data must be between 1 and 90 days.
For each publication instance, the retention period for consumed data starts if all the subscribers have either successfully consumed or discarded the data. That is, after all the events that are associated with the publication instance are either in a Complete or in a Discarded event status.
Retention period for unconsumed data
Determines how long Cloud Integration Hub retains unconsumed data in the publication repository before it deletes the data. The retention period for unconsumed data must be between the retention period for consumed data and 90 days.
For each publication instance, the retention period for unconsumed data starts after the data is published.
The Topic Structure area of topic page includes the following properties:
Create Table From
Add tables to the topic. The topic must contain at least one table.
You can use one or more of the following methods to add tables to the topic:
- Create a table from a connection. Use this method when the structure of a table in the data domain that the topic represents exists in a connection object. You can use relational, flat file, JDBC_IC, JDBCV2, and Salesforce connections to create topic tables. The Add Table From Connection dialog box shows up to 200 tables. You can also search for an object from a connection.
- Create a table from a flat file. Use this method when the structure of a table in the data domain that the topic represents exists in a flat file.
- Create a new table. Use this method to define the structure manually if the structure of the table does not exist in a compatible file.
Show
Lists the tables in the topic. You can select to show a specific table.
The list of topic tables shows the following properties for each table:
Table
Name of the topic table. A topic table name must begin with an alphabetic character or underscore and can contain only ASCII alphanumeric characters or underscores. The name must be unique in the Cloud Integration Hub repository.
Note: The physical topic table name in the staging database might differ from the actual topic table name that you enter at the time of the topic table creation.
Column
Name of the table column. The name must begin with an alphabetic character or underscore and can contain only alphanumeric characters or underscores.
Filter Accelerator
Indicates that the column will be used in subscription queries and requires performance-related handling by Cloud Integration Hub. Use this indicator with topics that you plan to use for unbound subscriptions.
When you use filter accelerators, consider the following guidelines:
▪ Filter accelerators slow down the writing of publication data to the Cloud Integration Hub publication repository.
▪ Filter accelerators have no impact on subscriptions that do not use filters.
▪ In a hosted publication repository, to use a column as a filter accelerator, you must change the value of Encrypted to No for the column.
▪ You cannot use a column with a TEXT data type as a filter accelerator.
Data Type
Select from the list of available data types. By default, Cloud Integration Hub reads the data as string.
Precision
Available for string, decimal, and text data types.
For a string data type, the maximum precision is 4,000 characters.
For a decimal data type, the maximum precision is 38 characters.
For a text data type, the maximum precision is 4,000,000 characters if the Encrypted option is not selected, and 100,000 characters if the Encrypted option is selected.
Scale
Enabled only for data types that support data scaling.
For a decimal data type, the maximum scale is 30 characters if you use a hosted publication repository, and 38 characters if you use a private publication repository.
For a DATE_TIME data type, the default scale is 0. For example, if you define a scale of 2 for a DATE_TIME of 2022-02-04 00:40:23.946, Cloud Integration Hub rounds the DATE_TIME to 2022-02-04 00:40:23.950.
Encrypted
Determines whether Cloud Integration Hub encrypts the column. Applies to a hosted publication repository. Default is disabled.
You can choose to enable encryption for topic data except for columns with a DATE_TIME data type. This applies to a hosted publication repository. To use a column as a filter accelerator in your mappings, change the value of Encrypted to No for the column.
Required
You can specify a field in a relational topic table as Required. If you enable this option, ensure that the data is published to the required fields. If the published data doesn't meet the required mandatory fields criteria, the event fails.
Default is disabled.
Add Table from a Connection object
Add a topic table from a connection object that contains the structure of a table in the data domain that the topic represents. You can add tables from objects in relational, flat file, and Salesforce connections.
The Add Table from a Connection page includes the following properties:
Connection
Connection that contains the object to create the topic table from.
Source Object
Object to create the topic table from.
Formatting Options
Applies to flat file connections. Defines the delimiter, text qualifier, and escape character that are used in the file.
Table Name
Name of the topic table. The name must begin with an alphabetic character or underscore and can contain only ASCII alphanumeric characters or underscores. The name must be unique in the Cloud Integration Hub repository.
Add Table from Flat File properties
Add a topic table from a flat file that contains the structure of a table in the data domain that the topic represents.
The Add Table from Flat File page includes the following properties:
File
Name of the file that contains the structure of the data domain that the topic represents.
Drop a file into the File field or click Choose File to browse to and choose the sample file on which to base the table structure.
Table Name
Name of the topic table. The name must begin with an alphabetic character or underscore and can contain only ASCII alphanumeric characters or underscores. The name must be unique in the Cloud Integration Hub repository.
Import Column Names
Optional. Select this option to use the column names in the file as the default column headers in the table. Enter the number of the lines that serves as the file's header line in the From Line field.
Code page
Character encoding used in the file.
Default text length
Optional. Length of the text fields in the table.
Delimiter
Delimiter used in the file to separate between columns. Select a predefined delimiter or select Custom to define a custom delimiter.
Text qualifier
Optional. Symbols used in the file to enclose a string.
Load File
Loads the selected file and shows a preview of the file.
Preview
Shows the columns that will be added to the table after you load the file.
Add Table from Metadata File properties
Add a topic table from a metadata file that contains the structure of a table in the data domain that the topic represents.
The Add Table from Metadata File page includes the following properties:
File
Name of the file that contains the structure of the data domain that the topic represents.
Drop a file into the File field or click Choose File to browse to and choose the sample file on which to base the table structure.
Table Name
Name of the topic table. The name must begin with an alphabetic character or underscore and can contain only ASCII alphanumeric characters or underscores. The name must be unique in the Cloud Integration Hub repository.
Load File
Loads the selected file and shows the status of the file, valid or invalid. If a file is valid and Cloud Integration Hub converts source values to Cloud Integration Hub default values, the changes are listed in the Create Table from Metadata File page. For more information, see Using metadata files to create topic tables in a relational database.
Create New Table properties
Add a topic table and define the structure of a topic table manually.
The Create New Table page includes the following properties:
Table Name
Name of the table. The name must begin with an alphabetic character or underscore and can contain only ASCII alphanumeric characters or underscores. The name must be unique in the Cloud Integration Hub repository.
Number of columns
Number of columns in the table.
Publications properties
The Publications area of topic page includes the following properties:
New Publication
Create a publication that publishes data to the topic. For more information about creating publications, see .
Publication list
List of publications that publish data to the topic. When you right-click a publication, an actions menu opens. From the menu you can run, view, disable or enable, and delete the publication.
The publication list shows the following properties for each publication:
Name
Name of the publication.
Description
Description of the publication.
Mode
Publication mode, enabled or disabled. A disabled publication does not run according to schedule or by an external API. You can only run a disabled publication from the Explore page or from the topic page of the topic that the publication publishes to.
Last Modified
Date and time when the publication was last modified.
Subscriptions properties
The Subscriptions area of topic page includes the following properties:
New Subscription
Create a subscription that consumes data from the topic. For more information about creating subscriptions, see .
Subscription list
List of subscriptions that consume data from the topic. When you right-click a subscription, an actions menu opens. From the menu you can run, view, disable or enable, and delete the subscription. You can also get data that was published before the subscription subscribed to the topic and therefore was not consumed by the subscriber.
The subscription list shows the following properties for each subscription:
Name
Name of the subscription.
Description
Description of the subscription.
Mode
Mode of the subscription. Choose one of the following options:
▪ Enable. The subscription runs according to a schedule that you define in the Schedule page. You can also run the subscription manually from Cloud Integration Hub.
▪ Pause. The subscription does not run according to a schedule or by an external API. You can only run the subscription manually from Cloud Integration Hub to consume the delayed events.
▪ Disable. The subscription does not run according to a schedule or by an external API. You cannot run a disabled subscription manually from Cloud Integration Hub. If the related publication runs successfully, the disabled subscription doesn't create a delayed event. You cannot consume the published data when the subscription is in disabled mode.
Note: If you choose the When published data is ready option for scheduling a paused data integration or file ingestion task subscription, no delayed event is created when you run the associated publication. However, you can manually run the subscription in the Cloud Integration Hub only if there are delayed events for the subscription before setting it to paused.
Last Modified
Date and time when the subscription was last modified.