Streaming Ingestion and Replication

Streaming Ingestion and Replication is a separately licensed ingestion type of the Data Ingestion and Replication service. Streaming Ingestion and Replication can ingest and replicate data at scale from any streaming data sources, such as logs, clickstream, social media, and IoT sources. Use Streaming Ingestion and Replication to ingest high-volume, real-time data from streaming sources to on-premises and cloud storage. You can also track and monitor the progress of streaming ingestion and replication jobs.

To gather operational intelligence from streaming data or to perform real-time data warehousing, you need to collect and analyze the data before it becomes obsolete or corrupted. Use Streaming Ingestion and Replication to combine or separate data from streaming sources in real time. You can apply simple transformations on the data to ensure the data ingested is ready for analytics.

The Data Ingestion and Replication service has an easy-to-use interface that runs in Informatica Intelligent Cloud Services. Use the Streaming Ingestion and Replication service to define, deploy, undeploy, and monitor ingestion jobs. A job is an executable instance of an ingestion task.

You can collect streaming and IoT data from different sources, apply simple transformations to the data, and then ingest the data to different types of targets. You can ingest data from sources, such as Amazon Kinesis, event logs, Google PubSub, JMS, Kafka, MQTT, OPC UA, and REST V2. You can stream data to targets, such as Amazon Kinesis, Amazon S3, Azure Event Hubs, Databricks, Google BigQuery v2, Google Cloud Storage, Google PubSub, Kafka, and Microsoft Azure Data Lake Storage.