Application Ingestion and Replication
Use cases
System requirements
Application Ingestion and Replication architecture
General limitations and guidelines
Application Ingestion and Replication sources - preparation and usage
Guidelines for Marketo sources
Microsoft Dynamics 365 sources
NetSuite sources
Oracle Fusion Cloud sources
Salesforce sources
Salesforce Marketing Cloud sources
SAP ECC and SAP S4/HANA sources using the SAP ODP Extractor connector
SAP ECC and SAP S4/HANA sources using the SAP Mass Ingestion connector
SAP OData V2 sources
ServiceNow sources
Workday sources
Application Ingestion and Replication target types - preparation and usage
Amazon Redshift targets
Amazon S3, Google Cloud Storage, Microsoft Azure Data Lake Storage Gen2, and Oracle Cloud Object Storage targets
Apache Kafka targets
Databricks targets
Google BigQuery targets
Microsoft Azure Synapse Analytics targets
Microsoft Azure SQL Database and SQL Server targets
Microsoft Fabric OneLake targets
Oracle targets
PostgreSQL targets
Snowflake targets
Default directory structure of CDC files on Amazon S3, Google Cloud Storage, Microsoft Azure Data Lake Storage Gen2, and Microsoft Fabric OneLake targets
Custom directory structure for output files on Amazon S3, Google Cloud Storage, Microsoft Fabric OneLake, and ADLS Gen2 targets
Avro data types
Key concepts
Integrating Application Ingestion and Replication tasks with Data Integration taskflows
Handling source schema changes
Ability to apply deletes as soft deletes on the target
Apply an audit history of all source table change operations to target tables
Configuring an application ingestion and replication task
Before you begin
Starting the ingestion and replication task wizard
Primary cloud data warehouse setup
Choose a runtime environment
Configure the destination connection
Configure the source connection
Task details: Configure how to replicate data from the source
Task details: Configure how to replicate data to the target
Transform the data
Finalize the task definition
Deploying an application ingestion and replication task
Running an application ingestion and replication job
Managing application ingestion and replication jobs
Stopping an application ingestion and replication job
Resuming an application ingestion and replication job
Overriding schema drift options when resuming an application ingestion and replication job
Redeploying an application ingestion and replication job
Undeploying an application ingestion and replication job
Aborting an application ingestion and replication job
Resynchronizing source and target objects
Default data-type mappings
Marketo Source and Amazon Redshift Target
Marketo Source and Databricks Target
Marketo Source and Google BigQuery Target
Marketo Source and Microsoft Azure Synapse Analytics Target
Marketo Source and Oracle Target
Marketo Source and Snowflake Target
Microsoft Dynamics 365 Source and Amazon Redshift Target
Microsoft Dynamics 365 Source and Databricks Target
Microsoft Dynamics 365 Source and Google BigQuery Target
Microsoft Dynamics 365 Source and Microsoft Azure Synapse Analytics Target
Microsoft Dynamics 365 Source and Microsoft Azure SQL Database Target
Microsoft Dynamics 365 Source and Oracle Target
Microsoft Dynamics 365 Source and Snowflake Target
NetSuite Source and Amazon Redshift Target
NetSuite Source and Databricks Target
NetSuite Source and Google BigQuery Target
NetSuite Source and Microsoft Azure Synapse Analytics Target
NetSuite Source and Oracle Target
NetSuite Source and Snowflake Target
Oracle Fusion Cloud source and Amazon Redshift target
Oracle Fusion Cloud source and Databricks target
Oracle Fusion Cloud source and Google BigQuery target
Oracle Fusion Cloud source and Oracle target
Oracle Fusion Cloud source and Microsoft Azure Synapse Analytics target
Oracle Fusion Cloud source and Microsoft Azure SQL Database target
Oracle Fusion Cloud source and Microsoft SQL Server target
Oracle Fusion Cloud source and Snowflake target
Salesforce Source and Amazon Redshift Target
Salesforce Source and Databricks Target
Salesforce Source and Google BigQuery Target
Salesforce Source and Microsoft Azure Synapse Analytics Target
Salesforce Source and Microsoft Azure SQL Database Target
Salesforce Source and Oracle Target
Salesforce Source and PostgreSQL Target
Salesforce Source and Snowflake Target
Salesforce Marketing Cloud Source and Amazon Redshift Target
Salesforce Marketing Cloud Source and Databricks Target
Salesforce Marketing Cloud Source and Google BigQuery Target
Salesforce Marketing Cloud Source and Microsoft Azure Synapse Analytics Target
Salesforce Marketing Cloud Source and Oracle Target
Salesforce Marketing Cloud Source and Snowflake Target
SAP Source and Amazon Redshift Target
SAP Source and Databricks Target
SAP Source and Google BigQuery Target
SAP Source and Microsoft Azure Synapse Analytics Target
SAP Source and Oracle Target
SAP Source and Snowflake Target
SAP Mass Ingestion connection Source and Amazon Redshift Target
SAP Mass Ingestion connection Source and Databricks Target
SAP Mass Ingestion connection Source and Google BigQuery Target
SAP Mass Ingestion connection source and Microsoft Azure Synapse Analytics Target
SAP Mass Ingestion connection Source and Oracle Target
SAP Mass Ingestion connection Source and Snowflake Target
SAP ODP Source and Amazon Redshift Target
SAP ODP Source and Databricks Target
SAP ODP Source and Google BigQuery Target
SAP ODP Source and Microsoft Azure Synapse Analytics Target
SAP ODP Source and Oracle Target
SAP ODP Source and Snowflake Target
ServiceNow Source and Amazon Redshift Target
ServiceNow Source and Databricks Target
ServiceNow Source and Google BigQuery Target
ServiceNow Source and Microsoft Azure Synapse Analytics Target
ServiceNow Source and Oracle Target
ServiceNow Source and Snowflake Target
Workday Source and Amazon Redshift Target
Workday Source and Databricks Target
Workday Source and Google BigQuery Target
Workday Source and Microsoft Azure Synapse Analytics Target
Workday Source and Oracle Target
Workday Source and Snowflake Target
Application Ingestion and Replication
Default data-type mappings
APPMI_TASKS_PAGE_LIST
CDIR_DESTINATION_STEP_APPMI_TASK
CDIR_SOURCE_STEP_APPMI_TASK
TASKDETAILS_SRC_APPMI_TASK_MARKETO
TASKDETAILS_SRC_APPMI_TASK_MSD365
TASKDETAILS_SRC_APPMI_TASK_NETSUITE
TASKDETAILS_SRC_APPMI_TASK_ORACLE_FUSION_CLOUD
TASKDETAILS_SRC_APPMI_TASK_SALESFORCE
TASKDETAILS_SRC_APPMI_TASK_SALESFORCE_MARKETING_CLOUD
TASKDETAILS_SRC_APPMI_TASK_SAP_ODATA_V2
TASKDETAILS_SRC_APPMI_TASK_SAP_ABAP
TASKDETAILS_SRC_APPMI_TASK_SAP
TASKDETAILS_SRC_APPMI_TASK_SERVICENOW
TASKDETAILS_SRC_APPMI_TASK_WORKDAY
TASKDETAILS_TGT_APPMI_TASK_AMAZON_REDSHIFT
TASKDETAILS_TGT_APPMI_TASK_S3
TASKDETAILS_TGT_APPMI_TASK_DATABRICKS_DELTA_LAKE
TASKDETAILS_TGT_APPMI_TASK_GOOGLE_BIG_QUERY
TASKDETAILS_TGT_APPMI_TASK_GCS
TASKDETAILS_TGT_APPMI_TASK_KAFKA
TASKDETAILS_TGT_APPMI_TASK_ADLS_GEN2
TASKDETAILS_TGT_APPMI_TASK_AZURE_SQL_DATA_WH
TASKDETAILS_TGT_APPMI_TASK_ONE_LAKE
TASKDETAILS_TGT_APPMI_TASK_MSSQL
TASKDETAILS_TGT_APPMI_TASK_ORACLE_CLOUD_STORAGE
TASKDETAILS_TGT_APPMI_TASK_ORACLE
TASKDETAILS_TGT_APPMI_TASK_POSTGRESQL
TASKDETAILS_TGT_APPMI_TASK_SNOWFLAKE
TRANSFORM_APPMI_TASK
FINAL_APPMI_TASK