Streaming Ingestion and Replication
Use cases
Streaming Ingestion and Replication sources
Amazon Kinesis Streams sources
AMQP sources
Azure Event Hubs Kafka sources
Business 360 Events sources
Flat File sources
Google PubSub sources
JMS sources
Kafka sources
MQTT sources
OPC UA sources
REST V2 sources
Streaming Ingestion and Replication targets
Amazon Kinesis Data Firehose target
Amazon Kinesis Streams target
Amazon S3 target
Databricks target
Flat file target
Google BigQuery V2 target
Google Cloud Storage V2 target
Google PubSub target
JDBC V2 target
Kafka target
Microsoft Azure Data Lake Storage Gen2 target
Microsoft Azure Event Hubs target
Transformations in Streaming Ingestion and Replication
Data formats
Combiner transformation
Filter transformation
Format Converter transformation
Java transformation
Jolt transformation
Python transformation
Splitter transformation
Configuring a streaming ingestion and replication task
Before you begin
Defining basic task information
Configuring a source
Configuring a target
Configuring a transformation
Configuring runtime options
Deploying a streaming ingestion and replication task
Undeploying a streaming ingestion and replication job
Stopping and resuming streaming ingestion and replication jobs
Frequently asked questions for Streaming Ingestion and Replication behavior
Streaming Ingestion and Replication REST API
Deploying, undeploying, starting, and stopping streaming ingestion and replication tasks
Deploying a streaming ingestion and replication task
Undeploying a streaming ingestion and replication task
Starting a streaming ingestion and replication task
Stopping a streaming ingestion and replication task
Copying a streaming ingestion and replication task
Updating a streaming ingestion and replication task
POST request
POST response
Getting details about a streaming ingestion and replication job
Getting a list of streaming ingestion and replication jobs
Job status
Job statistics
Job history
Streaming Ingestion and Replication
Job history
SI_TASKS_PAGE_LIST
STREAMING_INGESTION_TASK
SI_DEFINITION
SI_SOURCE
SI_TARGET
SI_TRANSFORMATION
SI_NEW_TRANSFORMATION
SI_RUNTIMEOPTIONS