Before you create a catalog source, ensure that you have the information required to connect to the source system.
Perform the following tasks:
•Assign the required permissions.
•Save the Microsoft Fabric Data Warehouse files on the runtime environment from which you want to extract metadata.
•Create a connection to the Microsoft Fabric Data Warehouse source system in Administrator.
•Create endpoint catalog sources for connection assignment.
•Optionally, if you want to identify pairs of similar columns and relationships between tables within a catalog source, import a relationship inference model.
Verify permissions
To extract metadata and to configure other capabilities that a catalog source might include, you need account access and permissions on the source system. The permissions required might vary depending on the capability.
Permissions for metadata extraction
To extract Microsoft Fabric Data Warehouse metadata, you need account access and permissions to the Microsoft Fabric Data Warehouse source system. To extract metadata from Microsoft Fabric data warehouses within a Microsoft Fabric workspace, you need access to the workspace with contributor or higher permissions.
Grant permissions that allow you to perform the following operations:
•select on sys.all_columns
•select on sys.all_objects
•select on sys.all_parameters
•select on sys.database_principals
•select on sys.databases
•select on sys.foreign_key_columns
•select on sys.indexes
•select on sys.index_columns
•select on sys.partitions
•select on sys.schemas
•select on sys.sql_modules
•select on sys.synonyms
•select on sys.tables
•select on sys.extended_properties
•select on sys.external_data_sources
•select on sys.types
•select on sys.table_types
•select on sys.external_tables
Permissions to run data profiles
You can run profiles with the permissions required to perform metadata extraction.
Create a connection
Before you configure the Microsoft Fabric Data Warehouse catalog source, create a connection object in Administrator.
Use the Microsoft Entra ID service principal, formerly known as Azure Active Directory, to create a Microsoft Fabric Data Warehouse connection in Administrator.
1In Administrator, select Connections.
2Click New Connection.
3Enter properties specific to the Microsoft Fabric Data Warehouse connection:
Property
Description
Connection Name
Name of the connection.
Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
Maximum length is 255 characters.
Description
Description of the connection. Maximum length is 4000 characters.
Type
Microsoft Fabric Data Warehouse
Runtime Environment
The name of the runtime environment where you want to run tasks.
Select a Secure Agent, Hosted Agent, or serverless runtime environment.
SQL Connection String
The SQL connection string to connect to Microsoft Fabric Data Warehouse.
Specify the connection string in the following format:
<Server>.datawarehouse.pbidedicated.windows.net
Client ID
The application ID or client ID of your application registered in Azure Active Directory for service principal authentication.
Client Secret
The client secret for your application registered in Azure Active Directory.
Tenant ID
The tenant ID of your application registered in Azure Active Directory.
Workspace
The name of the workspace in Microsoft Fabric Data Warehouse that you want to connect.
Database
The name of the database in Microsoft Fabric Data Warehouse that you want to connect.
4The following table describes the advanced connection property:
Property
Description
Schema Name
The name of the schema in Microsoft Fabric Data Warehouse where the tables are stored.
5Click Test Connection.
Create endpoint catalog sources for connection assignment
An endpoint catalog source represents a source system that the catalog source references. Before you perform connection assignment, create endpoint catalog sources and run the catalog source jobs.
You can then perform connection assignment to reference source systems and run connection-aware scans to view complete lineage with source system objects.