Read about new features and enhancements in the May 2024 Mass Ingestion release.
Common
The May 2024 release of Informatica Intelligent Cloud ServicesData Ingestion and Replication service includes the following new features that are common to multiple types of ingestion tasks.
Unified Home page
Most Mass Ingestion organizations will see a new Home page that provides a guided and unified experience for Data Integration and Data Ingestion and Replication users.
The Home page provides a central place from which you can create tasks, mappings, taskflows, and other assets, depending on your licensing. You can also access your recently created or updated assets and check the statuses of your recent jobs.
The panels that appear on the Home page are customized based on criteria such as the organization's licenses and the user's roles. For example, the following Home page is displayed for an Admin user in an organization that uses both Data Ingestion and Replication and Data Integration:
The navigation bar on the left side still provides the traditional New, Explore, and My Jobs options for creating a new task, exploring all assets, and viewing all of your jobs.
Limitations in the May 2024 release include:
•If you use the localized Japanese version of the user interface, or if you onboard to Data Ingestion and Replication after the May 2024 release is rolled out, the pre-existing Data Integration Home page appears instead of the new unified Home page. On this Home page, you can use the New, Explore, and My Jobs options in the navigation bar to create ingestion tasks, access your assets, and view details for your jobs. The new unified Home page is planned to be available to all Data Ingestion and Replication users in the July 2024 release.
•If you use the Do you use a cloud data warehouse as your primary destination? panel on the Home page to define a cloud data warehouse target like Snowflake, the information will not appear on the Target page of the task wizard when you create a new ingestion task. However, you can define the target from the task wizard.
New UI look and feel
Along with the new unified home page, the Data Ingestion and Replication user interface has a fresh look and feel with a lighter palette, updated icons, and new fonts.
Monitoring ingestion jobs in the Monitor service and from the unified Home page
You can now view and monitor ingestion jobs, along with other job types, in the Monitor service. You can monitor the progress and status of all jobs and all running jobs on the All Jobs and Running Jobs pages, respectively. On either page, you can click any job name to drill down to detailed information about the job. You can also perform some actions on the listed jobs, depending on the job status and task type, by using the Actions menu at the right end of each job row. To help you find your jobs more easily, the All Jobs page provides Filter, Find, and Sort options.
Alternatively, you can monitor all of your jobs, including ingestion and integration jobs, on the My Jobs page that is accessed by clicking My Jobs on the navigation bar of the unified Home page.
Note: You can continue to monitor only ingestion jobs on the Mass Ingestion page in Operational Insights.
Microsoft Fabric OneLake targets in incremental load and combined load jobs
You can now use Microsoft Fabric OneLake as a target for application ingestion and database ingestion incremental load and combined initial and incremental load jobs.
Previously Microsoft Fabric OneLake was available as a target in initial load jobs only.
Secure Agent identified in the application ingestion and database ingestion job details.
The name of the Secure Agent on which an application ingestion or database ingestion job runs is now displayed in the job-specific details. To access the job details, drill down on a job from the My Jobs page in the Data Integration service, the All Jobs and Running Jobs pages in the Monitor service, or from the Mass Ingestion page in Operational Insights service.
For an initial load job, the Agent Name is displayed in the Object Detail pane. For an incremental load job, the Agent Name is displayed in the Overview section of the Task Summary pane. For combined initial and incremental load jobs, the Agent Name is displayed in both the Object Detail pane and the Overview section.
This enhancement was introduced to help identify the Secure Agent for which logs must be collected for troubleshooting when the job runs on a Secure Agent group and one of the tasks fails. Previously, if a task failed and the job was running in a Secure Agent group, you had to manually run the log collector on all of the Secure Agents in the Secure Agent group.
If an incremental load job fails over from one Secure Agent to another, the latest Secure Agent assigned to the job is displayed. If you need to collect logs for a previously assigned Secure Agent, download the complete log from each of the Secure Agents in the Secure Agent group.
Mass Ingestion Databases
The May 2024 release of Database Ingestion and Replication includes the following new features and enhancements:
Data validation for initial load jobs that have an Oracle or SQL Server source and a Snowflake target
Note: The data validation feature availability is controlled by means of an organization-level feature flag. If this functionality is not available for your organization but you want to use it, create a request for Informatica Global Customer Support.
For database ingestion initial load jobs that have an Oracle or SQL Server source and a Snowflake target, you can now use a new data validation mechanism to compare the target data with the corresponding source object. Database Ingestion and Replication checks data consistency to ensure that all data has been correctly replicated to the appropriate target columns without any data conversion or truncation.
The data validation option is available only for tasks that have the status of Completed.
You can run data validation in the Object Detail pane of monitoring job-specific details. To access the Object Detail pane, drill down on a job from the My Jobs page in the Data Integration service, the All Jobs and Running Jobs pages in the Monitor service, or from the Mass Ingestion page in Operational Insights service.
When you run data validation in the Database Ingestion and Replication service, you will be charged based on the CPU consumption on the system where the Data Validation service runs.
Enhancements to Db2 for z/OS stored procedure processing
For database ingestion incremental load and combined initial and incremental load jobs that have Db2 for z/OS sources, the following enhancements have been made to Db2 for z/OS stored procedure capture processing:
•You can configure the stored procedure to skip empty URs when collecting log data from the z/OS system to help improve performance. Use the pwx.cdcreader.ZOS.strproc.skipEmptyUR custom property.
•During change data capture, Mass Ingestion Databases can now pass up to 16 KB of source table filtering information to the Db2 for z/OS stored procedure. Previously, the maximum was 4 KB. If the amount of filtered data exceeds 16 KB, Mass Ingestion Databases displays an error message.
