When you register a catalog source, provide general information and connection values.
1Log in to Intelligent Data Management Cloud.
The My Services page appears.
2Click Metadata Command Center.
The Metadata Command Center box appears on the My Services page.
The Metadata Command Center home page appears.
3Click New.
4Select Catalog Source from the list of asset types.
5Select Kafka from the list of catalog source types.
The following image shows the Kafka catalog source:
6Click Create.
The New Catalog Source page opens.
The following image shows the Registration tab on the New Catalog Source page:
7In the General Information section, enter a name and an optional description for the catalog source.
Note:
You can rename a catalog source after you create it, but to apply the change to all associated objects you must rerun the metadata extraction job.
After you save the catalog source, you can update the description in and . The update appears only in the service in which you update it.
8In the Connection Information area, select the connection that you created in Administrator.
Note:
To create or edit a catalog source, you need permissions on the connection to the source system. Select a connection that you have access to, or ask the administrator to grant the necessary permissions to the connection that you want to use.
9Choose one of the following Kafka distributions options:
1Apache Kafka. A distributed event streaming platform on premises for data pipelines, streaming analytics, and data integration.
2Confluent Platform. An improved on premises distributed event streaming platform, based on Apache Kafka.
3Confluent Cloud. A fully managed streaming data service on cloud, based on Apache Kafka.
The following table describes the properties to configure for the Confluent Cloud distribution option:
Property
Description
Schema Registry URL
URL to access the schema registry. The URL syntax is http://host1:port1.
Confluent Cloud API Key
API key to manage access and authentication to Confluent Cloud.
Confluent Cloud API Secret
API secret for the Confluent Cloud API key.
Confluent Cloud Schema Registry API Key
API key to interact with schema registry in Confluent Cloud.
Confluent Cloud Schema Registry API Secret
API secret for the Confluent Cloud schema registry API key.
10Click Connection Properties to expand and view the connection properties for the selected connection.
11Click Test Connection to test your connection to the source system.