Enterprise Data Catalog
This section describes the new Enterprise Data Catalog features in version 10.4.0.
Assigning Custom Attributes to Resources and Classes
Effective in version 10.4.0, you can assign custom attributes to specific resources and classes in the catalog or to all resources and classes in the catalog. You can perform this task when you create or modify a custom attribute.
For more information, see the Informatica 10.4.0 Catalog Administrator Guide.
New Resources
Effective in version 10.4.0, the following new resources are added in Enterprise Data Catalog:
- •AWS Glue
- •Microsoft Power BI
- •Apache Cassandra
- •Snowflake
- •Google Cloud Storage
You can extract metadata, relationship and lineage information from all the above resources. For more information, see the Informatica 10.4.0 Enterprise Data Catalog Scanner Configuration Guide.
Reference Resources and Reference Assets
Effective in version 10.4.0, you can configure resources to extract metadata about data sources or other resources in the catalog referenced by the resource. Examples include source and target tables in PowerCenter mappings, and source tables and files from Tableau reports. These referenced data sources are referred to as Reference Resources and the assets included in the data sources are referred to as reference assets. You can view the reference resources and reference assets in Enterprise Data Catalog applications. To view the complete lineage in Enterprise Data Catalog, you can perform connection assignments for the reference resources. You can perform connection assignments between the reference resources and the resources you configure in Enterprise Data Catalog for the reference resource data sources.
You can configure the following resources to extract metadata about data sources or other resources in the catalog referenced by the resource:
- •PowerCenter
- •AWS Glue
- •Tableau Server
- •Coudera Navigator
- •Apache Atlas
- •Informatica Intelligent Cloud Services
- •Informatica Platform
- •SQL Server Integration Service
For more information, see the Informatica 10.4.0 Catalog Administrator Guide and the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Export Assets from Search Results
Effective in version 10.4.0, you can export all the assets that appear in the search results to the comma-separated values (CSV) file and import the CSV file back into Enterprise Data Catalog. Export assets after you refine the search results on any search tab.
For more information, see the Asset Tasks chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Lineage and Impact Filters
Effective in version 10.4.0, you can create and apply filters to the Lineage and Impact view. Use filters to narrow down the results in the Lineage and Impact view. Create customized filters using different combinations of filter options based on the asset types available in the Lineage and Impact view.
For more information, see the View Lineage and Impact chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Asset Control Summary
Effective in version 10.4.0, you can view control flow assets in the Asset Control Summary tab for table and file asset types. A control flow places constraints or conditions on the flow of data. For example, a SQL query can contain constraints in the WHERE clause or mappings can contains transformations.
For more information, see the View Lineage and Impact chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Rules and Scorecards
Effective in version 10.4.0, you can extract rule and scorecard results from the profiling warehouse and view them in Enterprise Data Catalog. You can view the column results for a rule and scorecard to measure data quality of the data source.
For more information, see the View Assets chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Unique Key Inference
Effective in version 10.4.0, you can generate unique key candidates from the columns in the source data object. You can view the unique key inference results to understand data quality issues by identifying the columns that have duplicate values.
You can accept or reject the inferred unique key inference results. After you accept or reject an inferred unique key inference, you can reset the unique key inference to restore the inferred status.
For more information, see the View Assets chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
Data Domain Discovery on the CLOB File Type
Effective in version 10.4.0, you can perform data domain discovery on the CLOB file type.
For more information, see the Enterprise Data Catalog Concepts chapter in the Informatica 10.4.0 Enterprise Catalog Administrator Guide.
Data Discovery and Sampling Options on the Spark Engine
Effective in version 10.4.0, you can run profiles to discover data domains and choose sampling options on the Spark Engine.
- Data Domain Discovery on the Spark Engine
- You can perform data domain discovery on the Spark engine.
- Sampling Options on the Spark Engine
- You can choose the following sampling options to discover data domains on the Spark engine:
- - Limit n sampling option runs a profile based on the number of the rows in the data object. When you choose to discover data domains in the Hadoop environment, the Spark engine collects samples from multiple partitions of the data object and pushes the samples to a single node to compute sample size.
- - Random percentage sampling option runs a profile on a percentage of rows in the data object.
For more information, see the Enterprise Data Catalog Concepts chapter in the Informatica 10.4.0 Enterprise Catalog Administrator Guide.
Tracking Technical Preview
Enterprise Data Catalog version 10.4.0 includes functionality that is available for technical preview.
Technical preview functionality is supported but is unwarranted and is not production-ready. Informatica recommends that you use in non-production environments only. Informatica intends to include the preview functionality in an upcoming GA release for production use, but might choose not to in accordance with changing market or technical circumstances. For more information, contact Informatica Global Customer Support.
- •Effective in version 10.4.0, you can choose to display the compact view of the lineage and Impact view. The compact lineage and impact view displays the lineage and impact diagram summarized at the resource level.
For more information, see the View Lineage and Impact chapter in the Informatica 10.4.0 Enterprise Data Catalog User Guide.
- •Effective in version 10.4.0, you can extract metadata from the SAP Business Warehouse, SAP BW/4HANA, IBM InfoSphere DataStage, and Oracle Data Integrator sources when they are inaccessible at runtime or offline.
For more information, see the Informatica 10.4.0 Catalog Administrator Guide..
- •Effective in version 10.4.0, you can extract metadata from the SAP Business Warehouse and SAP BW/4HANA data sources.
For more information, see the Informatica 10.4.0 Enterprise Data Catalog Scanner Configuration Guide..
Data Preview and Provisioning
Effective in version 10.4.0, you can perform data provisioning after you complete data discovery in the catalog. Data provisioning helps you to move data to a target for further analysis. You can preview data for relational sources to assess the data before you move it to the target.
For more information about previewing and provisioning data, see the Informatica 10.4.0 Catalog Administrator Guide and Informatica 10.4.0 Enterprise Data Catalog User Guide .
Supported Resource Types for Standalone Scanner Utility
Effective in version 10.4, you can extract metadata from the following external sources when they are inaccessible at runtime or offline:
- •Amazon Redshift
- •Amazon S3
- •Apache Cassandra
- •Axon
- •Azure Data Lake Store
- •Azure Microsoft SQL Data Warehouse
- •Azure Microsoft SQL Server
- •Business Glossary
- •Custom Lineage
- •Database Scripts
- •Erwin
- •Glue
- •Google BigQuery
- •Google Cloud Storage
- •Informatica Cloud Service
- •IBM Cognos
- •Microsoft Azure Blob Storage
- •Microsoft SQL Server Integration Services
- •PowerBI
- •QlikView Business Intelligence
- •Salesforce
- •SAP HANA
- •SAP PowerDesigner
- •Snowflake
- •Workday
For more information, see the "Metadata Extraction from Offline and Inaccessible Resources" chapter in the Informatica 10.4 Enterprise Data Catalog Administrator Guide.
REST APIs
Effective in version 10.4, you can use the following Informatica Enterprise Data Catalog REST APIs:
- •Data Provision REST APIs. In addition to the existing REST APIs, you can view whether data provisioning is available to the user and list the resources that support data provisioning.
- •Lineage Filter REST APIs. You can create, update, list, or delete a lineage filter.
- •Model Information REST APIs. In addition to the existing REST APIs, you can list the predefined slider facets, slider facet definition, and lineage filter definitions.
- •Model Modification REST API. In addition to the existing REST APIs, you can create, update, and delete a slider facet definition.
- •Monitoring Info REST APIs. You can submit or list jobs which includes jobs of object export type, object import type, resource export type, and search export type.
- •Object Child Count REST API. You can list the total number of child assets for an object.
- •Product Info REST API. You can list the details about Enterprise Data Catalog which includes the release version, build version, and build date.
For more information about the REST APIs, see the Informatica 10.4 Enterprise Data Catalog REST API Reference.