Use Data Integration to load, transform, and integrate your data. You can create data integration projects and run data integration tasks.
Data Integration is an on-demand subscription service that provides a complete platform for cloud data integration and management. You can use Data Integration to build and run advanced, complex integrations using pre-built functions and templates for mappings and transformations. Data Integration has the features you need to create a variety of data integration projects to fit your business needs.
Home page
When you select Data Integration from the My Services page, the Home page appears. The Home page provides a guided and unified experience for Data Integration users and Data Ingestion and Replication users.
The Home page is customized for each user in an organization. It displays different panels based on the following criteria:
•Your organization's licenses
•Your user roles
•Whether you've configured a primary cloud data warehouse
•Whether your organization has any runtime environments
•Whether you've created assets or run jobs
For example, if you're an Admin user who has already created assets and run jobs, you might see a Home page that looks like the following image:
The page displays the following rows of panels:
Do you use a cloud data warehouse as your primary destination?
This panel appears if you haven't selected a cloud data warehouse as your primary destination. Click Next to select a primary cloud data warehouse. If you load data to different destinations, you can dismiss this panel and move it to the bottom of the page.
Primary task panels
Use the following panels to load and transform your data:
- Ingest. Create Data Ingestion and Replication tasks to ingest and replicate your data.
- Transform. Create data transfer tasks or mappings to load and transform your data.
- Orchestrate. Create taskflows to define the control flow logic for your tasks.
If you've chosen a primary cloud data warehouse, the panel names include the data warehouse type, for example, Ingest into Snowflake.
Recent assets, Recent jobs
These panels display the assets you've most recently modified and the jobs you've most recently run.
Secondary task panels
These panels allow you to perform other tasks like adding users, creating connections, or creating mapplets.
Help panels
Use these panels to view getting started information or access the community for help.
Usage, Runtime environments
These panels allow you to access your usage metrics and view the status of the runtime environments available to you, respectively.
Try out our mapping templates!
Click this panel to create a mapping based on a pre-defined mapping template.
You can also access the following pages from the navigation bar:
•New. Create new data integration assets such as mappings, tasks, and taskflows. You can create assets from scratch or use templates as a head start.
•Home. Return to the Home page.
•Explore. Create and manage projects and assets.
•Bundles. Create and manage bundles of assets to share with your organization or other organizations.
•My Jobs. View the status of your mapping, task, and taskflow instances.
•My Import/Export Logs. View the status of your imports and exports.
When you switch from Data Integration to another service such as Administrator or Monitor, the options in the navigation bar change to suit the service.
Data Integration tasks
You can integrate and transform your data in Data Integration using the following tasks:
•Mapping task. Process data based on the data flow logic that you define in a mapping.
•Synchronization task. Load data and integrate applications, databases, and files. Includes add-on functionality such as mapplets.
•Masking task. Replace source data in sensitive columns with realistic test data for non-production environments. Masking rules define the logic to replace the sensitive data. Assign masking rules to the columns you need to mask.
•Replication task. Replicate data from Salesforce or database sources to database or file targets. You might replicate data to archive the data, perform offline reporting, or consolidate and manage data.
•PowerCenter task. Import a PowerCenter workflow and run it as a Data Integration PowerCenter task.
•Dynamic mapping task. Use a dynamic mapping task to create and batch multiple jobs based on the same mapping.
•Data transfer task. Use a data transfer task to transfer data from a source to a target, for example, to transfer data from an on-premises database to a cloud data warehouse. Optionally, you can augment the source data with data from a lookup source and sort and filter the data before loading it to the target.
You can use taskflows for complex data integration projects. Taskflows orchestrate the execution sequence of multiple data integration tasks.
Data transformation options
You can transform your data in Data Integration using a wizard, the Mapping Designer, or the SQL ELT Mapping Designer.
When you click the Transform panel on the Home page, you see the following options for transforming your data:
Using a wizard
Select this option to create a data transfer task.
A data transfer task uses a step-by-step, wizard-based interface to transfer data from your source to your target. For example, you might create a data transfer task to transfer data from an on-premises database to your cloud data warehouse.
If you wish, you can augment the source data with data from a lookup source and also sort and filter the data before loading it to the target.
Using our mapping designer
Select this option to create a mapping using the Mapping Designer.
Create a mapping when you need flexibility in your sources, targets, and transformation options. A mapping can read and write to a wide variety of heterogeneous data sources. It also offers a large variety of data transformation options.
If you select this option, you can switch to advanced mode to process multilevel hierarchical data, embedded code snippets, or workloads at any scale. Mappings in advanced mode require an advanced cluster to run the mapping logic.
When you run a mapping or a mapping in advanced mode, Data Integration processes the transformation logic. However, you can choose to push some or all the transformation logic to the source, to the target, or both.
Using our SQL ELT mapping designer
Select this option to create a mapping in SQL ELT mode using the Mapping Designer.
Create a mapping in SQL ELT mode when your source and target are in the same cloud ecosystem and you want to perform the data transformation entirely within the cloud ecosystem. For example, you want to read data from your Snowflake cloud data warehouse or data lake, load it to your Snowflake cloud data warehouse, and perform all of the data transformation within Snowflake.
When you run a mapping in SQL ELT mode, Data Integration translates the transformation logic into ecosystem-specific SQL statements and commands that run in the underlying cloud data warehouse.
You can also create data transfer tasks and mappings by clicking New on the navigation bar.
Connectors
Informatica Intelligent Cloud Services can use a wide variety of connectors for data integration. You use connectors to create connections that provide access to data in cloud and on-premise applications, platforms, databases, and flat files.
Some Data Integration settings are connector-specific. For more information, see the help for the relevant connector.
Notifications
You receive notifications in Informatica Intelligent Cloud Services for certain events, including job status updates, license expiration, and workflow progress. You can view notifications in the notifications tray, manage them on the Notifications page, and receive alerts by email.
The Notifications icon on the toolbar displays the number of unread notifications. You can click the icon to view the latest unread notifications in the notifications tray. In Data Governance and Catalog, you can filter the tray to display only Data Governance and Catalog notifications. In other services, filtering the tray doesn't change the display.
You can view and manage all of your notifications on the Notifications page. To access the Notifications page, select View All Unread from the action menu in the notifications tray.
To receive notification alerts by email, configure the options in your user settings. For more information, see Editing your user settings.
