Before you create a catalog source, ensure that you have the information required to connect to the source system.
Perform the following tasks:
•Ensure that the dbt Core version is v1.7.x
•Create and run catalog source jobs for sources and targets that dbt connects to.
Note: The catalog source job only extracts metadata from compiled model files. Run the model and verify that the value of the compiled attribute is set to true in the manifest.json file located in the target folder of the dbt project.
For a list of referenced source systems, see Assign reference catalog source connections to endpoint catalog source objects.
Verify permissions
To extract metadata and to configure other capabilities that a catalog source might include, you need account access and permissions on the source system. The permissions required might vary depending on the capability.
Permissions for metadata extraction
You don't need additional permissions to perform metadata extraction.
Get dbt source information
Get the manifest.json files that contain the dbt project metadata from the target folders of the dbt projects and save them to a directory on the Secure Agent machine.
Note: You don't need to create a connection object in Administrator. You provide connection information when you configure the catalog source.
When you register a catalog source, for the dbt Manifest JSON Files property, enter the path to the manifest.json file located on the Secure Agent machine. You can specify files from multiple dbt projects.
Create endpoint catalog sources for connection assignment
An endpoint catalog source represents a source system that the catalog source references. Before you perform connection assignment, create endpoint catalog sources and run the catalog source jobs.
You can then perform connection assignment to reference source systems and run connection-aware scans to view complete lineage with source system objects.