Streaming Ingestion and Replication
Use cases
Streaming Ingestion and Replication sources
Amazon Kinesis Streams sources
AMQP sources
Azure Event Hubs Kafka sources
Business 360 Events sources
Flat File sources
Google PubSub sources
JMS sources
Kafka sources
MQTT sources
OPC UA sources
REST V2 sources
Streaming Ingestion and Replication targets
Amazon Kinesis Data Firehose target
Amazon Kinesis Streams target
Amazon S3 target
Databricks target
Flat file target
Google BigQuery V2 target
Google Cloud Storage V2 target
Google PubSub target
JDBC V2 target
Kafka target
Microsoft Azure Data Lake Storage Gen2 target
Microsoft Azure Event Hubs target
Transformations in Streaming Ingestion and Replication
Data formats
Combiner transformation
Filter transformation
Format Converter transformation
Java transformation
Jolt transformation
Python transformation
Splitter transformation
Configuring a streaming ingestion and replication task
Before you begin
Defining basic task information
Configuring a source
Configuring a target
Configuring a transformation
Configuring runtime options
Deploying a streaming ingestion and replication task
Undeploying a streaming ingestion and replication job
Stopping and resuming streaming ingestion and replication jobs
Frequently asked questions for Streaming Ingestion and Replication behavior
Streaming Ingestion and Replication REST API
Dataflows resource
Deploying a streaming ingestion and replication task
Undeploying a streaming ingestion and replication task
Starting a streaming ingestion and replication task
Stopping a streaming ingestion and replication task
CopyEntities resource
UpdateEntity resource
POST request
POST response
jobs resource
MIJobs resource
status resource
statistics resource
history resource
Streaming Ingestion and Replication
history resource
SI_TASKS_PAGE_LIST
STREAMING_INGESTION_TASK
SI_DEFINITION
SI_SOURCE
SI_TARGET
SI_TRANSFORMATION
SI_NEW_TRANSFORMATION
SI_RUNTIMEOPTIONS