Administrator Guide > Connection Properties > Kafka Connection Properties
  

Kafka Connection Properties

The Kafka connection is a Messaging connection. Use the Kafka connection to access an Apache Kafka broker as a source or a target. You can create and manage a Kafka connection in the Developer tool or through infacmd.
When you configure a Kafka connection, you configure the following properties:

General Properties

The following table describes the general connection properties for the Kafka connection:
Property
Description
Name
The name of the connection. The name is not case sensitive and must be unique within the domain. You can change this property after you create the connection. The name cannot exceed 128 characters, contain spaces, or contain the following special characters:
~ ` ! $ % ^ & * ( ) - + = { [ } ] | \ : ; " ' < , > . ? /
ID
The string that the Data Integration Service uses to identify the connection. The ID is not case sensitive. It must be 255 characters or less and must be unique in the domain. You cannot change this property after you create the connection. Default value is the connection name.
Description
The description of the connection. Enter a string that you can use to identify the connection. The description cannot exceed 4,000 characters.
Location
The domain where you want to create the connection. Select the domain name.
Type
The connection type. Select Messaging/Kafka.

Kafka Broker Properties

The following table describes the Kafka broker properties for the Kafka connection:
Property
Description
Kafka Broker List
Comma-separated list of Kafka brokers which maintain the configuration of the Kafka messaging broker.
To specify a Kafka broker, use the following format:
<IP Address>:<port>
Retry Timeout
Number of seconds after which the Integration Service attempts to reconnect to the Kafka broker to read or write data. If the source or target is not available for the time you specify, the mapping execution stops to avoid any data loss.
Kafka Broker Version
Configure the Kafka messaging broker version to Apache 0.10.1.1 & above.
Additional Connection Properties
Optional. Comma-separated list of connection properties to connect to the Kafka broker.
For example, you can use the following syntax:
request.timeout.ms=<value>,session.timeout.ms=<value>,
fetch.max.wait.ms=<value>,heartbeat.interval.ms=<value>,
security.protocol=SASL_PLAINTEXT,sasl.kerberos.
service.name=<kerberos name>,sasl.mechanism=GSSAPI,
sasl.jaas.config=com.sun.security.auth.module.
Krb5Login Modulerequired useKeyTab=true
doNotPrompt=true storeKey=true client=true
keyTab="<Keytab Location>" principal="<principal>";
To reduce the time taken to connect to the Kafka broker, ensure that you set the following properties:
  • - request.timeout.ms
  • - session.timeout.ms
  • - fetch.max.wait.ms
  • - heartbeat.interval.ms
To connect to the Kafka broker in a secured way, ensure that you set one of the following values for the security.protocol property:
  • - SASL_SSL
  • - SSL
The default value of security.protocol property is SASL_PLAINTEXT.
The Additional Connection Properties is available for technical preview. Technical preview functionality is supported but is unwarranted and is not production-ready. Informatica recommends that you use in non-production environments only.
For more information about the connection properties, see https://kafka.apache.org/documentation/.

SSL Properties

The following table describes the SSL properties for the Kafka connection:
Property
Description
SSL Mode
Required. SSL mode indicates the encryption type to use for the connection.
You can choose a mode from the following SSL modes:
  • - Disabled
  • - One way
  • - Two way
SSL TrustStore File Path
Required when One way SSL mode is selected.
Absolute path and file name of the SSL truststore file that contains certificates of the trusted SSL server.
SSL TrustStore Password
Required when One way SSL mode is selected.
Password for the SSL truststore.
SSL KeyStore File Path
Required when Two way SSL mode is selected.
Absolute path and file name of the SSL keystore file that contains private keys and certificates for the SSL server.
SSL KeyStore Password
Required when Two way SSL mode is selected.
Password for the SSL keystore.

Creating a Kafka Connection Using infacmd

You can use the infacmd command line program to create a Kafka connection.
To create a Kafka connection on UNIX, run the following command:
sh infacmd.sh createConnection -dn <domain name> -un <domain user> -pd <domain password> -cn <connection name> -cid <connection id> -ct Kafka -o kfkBrkList=<host1:port1>,<host2:port2>,<host3:port3> kafkabrokerversion=<version> additionalConnectionProperties=<additional properties>
For more information about the CreateConnection command, see the Informatica Command Reference.