Read about new features and enhancements in the October 2024 Data Ingestion and Replication release.
Common
The October 2024 release of Data Ingestion and Replication includes the following new features that are common to multiple types of ingestion and replication tasks.
New job metrics command available in the Data Ingestion and Replication Command-Line Interface
The Data Ingestion and Replication Command-Line Interface (CLI) provides a new job metrics command to display statistics for a specified job or a subtask of a job. This enhancement is available for application ingestion and replication jobs and database ingestion and replication jobs.
On the job level, the statistics include records read, records written, and capture progress.
On the subtask level, you can display the following statistics:
•Records read and records written for initial load jobs
•Counts of processed inserts, updates, deletes, and LOB changes for incremental and combined load jobs
•The number of records processed and replicated during the initial load phase of combined load jobs
You can use the -f field parameter to specify which of these values should be included in the output.
Application Ingestion and Replication
The July 2024 release of Application Ingestion and Replication includes the following new feature and enhancement:
Schema drift support for PostgreSQL targets
Application Ingestion and Replication adds support for automatic schema drift detection and handling for incremental load and combined initial and incremental load jobs that have a Salesforce source and a PostgreSQL target.
Database Ingestion and Replication
The October 2024 release of Database Ingestion and Replication includes the following new features and enhancements:
Soft Deletes for Google BigQuery targets
Database ingestion and replication incremental load jobs and combined initial and incremental load jobs can now process hard delete operations on the source as soft deletes on Google BigQuery targets. Database Ingestion and Replication marks the soft-deleted records with a "D" in the INFA_OPERATION_TYPE column on the target without actually deleting the records.
Streaming Ingestion and Replication
The July 2024 release of Streaming Ingestion and Replication includes the following new feature and enhancement:
Support for Business 360 Events Connector
Mass Ingestion Streaming now supports Business 360 Events connector as a source to transfer files.