Informatica Intelligent Cloud Services - Cloud Data Integration
Informatica Intelligent Cloud Services - Cloud Data Integration (IICS-CDI) is an on-demand subscription service that provides access to applications, databases, platforms, and flat files hosted on premise or on a cloud. IICS-CDI runs at a hosting facility.
Note: Effective in Enterprise Data Catalog version 10.5.2, the Informatica Intelligent Cloud Services - Cloud Data Integration (IICS-CDI) V2 resource type is available for technical preview. The Intelligent Cloud Services - Cloud Data Integration (IICS-CDI) V2 resource has the following new features:
- •Metadata extraction from the following types of input:
- - Project
- - Folder
- - Mappings
- - Mapping tasks
- - PowerCenter tasks
- - Synchronization tasks
- •Filtering on the following levels:
- •Reading the following CID paarameter files:
- - Connection parameters
- - Source target parameters
- - In/out parameters
- - Transformation parameters
- •Additional SQL parsing capabilities
Technical preview functionality is supported for evaluation purposes but is unwarranted and is not supported in production environments or any environment that you plan to push to production. Informatica intends to include the preview functionality in an upcoming release for production use, but might choose not to in accordance with changing market or technical circumstances. For more information, contact Informatica Global Customer Support.
For more information, see the MetaDex Scanner Configuration Guide.
Permissions to Configure the Resource
To access synchronization task, mapping task, and PowerCenter task objects in the IICS-CDI, the cloud user must have Cloud REST API license and read permission on the tasks.
Prerequisites
Before you add an IICS-CDI resource, perform the following steps:
- 1. Create an organization for your company on the IICS-CDI website, define the organization hierarchy, and configure the organization properties.
Note: To create an organization, you must have a REST API license. If you do not have a REST API license, contact Informatica Global Customer Support.
- 2. Create a subscription account on the Informatica Cloud.
- 3. Verify that the machine where you install the Informatica Cloud Secure Agent meets the minimum system requirements. The Informatica Cloud Secure Agent is a lightweight program that runs all tasks and enables secure communication across the firewall between your organization and the Informatica Cloud.
- 4. Download, install, and register the Informatica Cloud Secure Agent using the Informatica Cloud user name and password.
- 5. Create the following tasks on Informatica Cloud:
- a. Mapping tasks
A mapping defines reusable data flow logic that you can use in Mapping Configuration tasks. Use mapping to define data flow logic that is not available in Data Synchronization tasks, such as specific ordering of logic or joining sources from different systems. When you configure a mapping, you describe the flow of data from source and target. You can add transformations to transform data, such as an Expression transformation for row-level calculations or a Filter transformation to remove data from the data flow.
- b. PowerCenter tasks
The PowerCenter task allows you to import PowerCenter workflows in to Informatica Cloud and run them as Informatica Cloud tasks.
- c. Data synchronization tasks
The Data Synchronization task allows you to synchronize data between a source and target.
Note: A IICS-CDI resource imports all the tasks to Enterprise Data Catalog the first time metadata is extracted from the resource. During the subsequent extract operations, the resource imports only the updated tasks to Enterprise Data Catalog.
To extract metadata using an IICS-CDI resource, you must run the task at least once after you create or update the resource.
If the proxy server used to connect to the data source is SSL enabled, you must download the proxy server certificates on the Informatica domain machine.
For more information about the prerequisites, see the Informatica Cloud User Guide and the Informatica Cloud Administrator Guide.
Basic Information
The General tab includes the following basic information about the resource:
Information | Description |
---|
Name | The name of the resource. |
Description | The description of the resource. |
Resource type | The type of the resource. |
Execute On | You can choose to execute on the default catalog server or offline. |
Resource Connection Properties
The General tab includes the following properties:
Property | Description |
---|
Cloud URL | The URL to access the IICS-CDI. |
Username | The user name to connect to the IICS-CDI. |
Password | The password associated with the user name. |
Auto Assign Connections | Select this option to specify that the connection must be assigned automatically. |
Connect through a proxy server | Proxy server to connect to the data source. Default is Disabled. |
Proxy Host | Host name or IP address of the proxy server. |
Proxy Port | Port number of the proxy server. |
Proxy User Name | Required for authenticated proxy. Authenticated user name to connect to the proxy server. |
Proxy Password | Required for authenticated proxy. Password for the authenticated user name. |
The Metadata Load Settings tab includes the following properties:
Property | Description |
---|
Enable Source Metadata | Select to extract metadata from the data source. |
Detailed Lineage | Select to extract and ingest metadata related to transformation logic for assets that include transformations. A transformation indicates generation, modification, or passage of data between source and target connections. A transformation logic displays the mappings or data flow relation types between source assets and target assets related to the asset you select in Enterprise Data Catalog. |
Memory | Specifies the memory required to run the scanner job. Select one of the following values based on the data set size imported: Note: For more information about the memory values, see the Tuning Enterprise Data Catalog Performance article on How To-Library Articles tab in the Informatica Doc Portal |
Custom Options | JVM parameters that you can set to configure scanner container. Use the following arguments to configure the parameters: - - -Dscannerloglevel=<DEBUG/INFO/ERROR>. Changes the log level of scanner to values, such as DEBUG, ERROR, or INFO. Default value is INFO.
- - -Dscanner.container.core=<No. of core>. Increases the core for the scanner container. The value should be a number.
- - -Dscanner.yarn.app.environment=<key=value>. Key pair value that you need to set in the Yarn environment. Use a comma to separate the key pair value.
- - -Dscanner.pmem.enabled.container.memory.jvm.memory.ratio=<1.0/2.0>. Increases the scanner container memory when pmem is enabled. Default value is 1.
|
Auto Assign Connections | Select this option to specify that the connection must be assigned automatically. |
Enable Reference Resources | Extracts metadata about assets that are not included in this resource, but referred to in the resource. |