Big Data Streaming
This section describes changes to Big Data Streaming in version 10.2.2.
Big Data Streaming and Big Data Management Integration
Effective in version 10.2.2, to manage the target files in the target file system at run time, a temporary directory is created in the specified target file directory.
The temporary directory separates the target files to which the data is currently written and the target files that are closed after the rollover limit is reached.
Previously, all the target files were stored in the target file directory.
For more information, see the Informatica Big Data Streaming 10.2.2 User Guide.
Kafka Connection
Effective in version 10.2.2, Kafka broker maintains the configuration information for the Kafka messaging broker. Previously, Apache ZooKeeper maintained the configuration information for the Kafka messaging broker.
For more information, see the Big Data Streaming 10.2.2 User Guide.
Transformations
This section describes the changes to transformations in Big Data Streaming in version 10.2.2.
Aggregator Transformation
Effective in version 10.2.2, a streaming mapping must meet the following additional requirements if it contains an Aggregator transformation:
- •A streaming mapping must have the Window transformation directly upstream from an Aggregator transformation. Previously, you could use an Aggregator transformation anywhere in the pipeline after the Window transformation.
- •A streaming mapping can have a single Aggregator transformation. Previously, you could use multiple Aggregator transformations in a streaming mapping.
Joiner Transformation
Effective in version 10.2.2, a streaming mapping must meet the following additional requirements if it contains a Joiner transformation:
- •A streaming mapping must have the Window transformation directly upstream from a Joiner transformation. Previously, you could use a Joiner transformation anywhere in the pipeline after a Window transformation.
- •A streaming mapping can have a single Joiner transformation. Previously, you could use multiple Joiner transformations in a streaming mapping.
- •A streaming mapping cannot contain an Aggregator transformation anywhere before a Joiner transformation in a streaming mapping. Previously, you could use an Aggregator transformation anywhere before a Joiner transformation in a streaming mapping.