Talend Data Integration Sources > Create catalog sources in Metadata Command Center > Step 2. Configure capabilities
  

Step 2. Configure capabilities

When you configure the Talend Data Integration catalog source, you define the settings for the metadata extraction capability.
The metadata extraction capability extracts source metadata from external source systems. You can also configure other capabilities that the catalog source includes.
You can save the catalog source configuration at any point after you enter the connection information. After you save the catalog source, you can choose to run the catalog source job. To run the job once, click Run. To run metadata extraction and other capabilities on a recurring schedule, configure schedules on the Schedule tab.

Configure metadata extraction

When you configure the Talend Data Integration catalog source, you choose a runtime environment, define filters, and enter configuration parameters for metadata extraction.
Before you configure metadata extraction, configure runtime environments in the IDMC Administrator.
    1In the Connection and Runtime area, choose a serverless runtime environment or the Secure Agent group where you want to run catalog source jobs.
    Note:
    Serverless runtime environment options are available if the catalog source works with a serverless runtime environment.
    2Choose to retain, delete, or deprecate objects that are deleted from the source system in the catalog with the Metadata Change Option.
    Note:
    You can also change the configured metadata change option when you run a catalog source.
    3In the Filters area, define one or more filter conditions to apply for metadata extraction:
    1. aSelect Yes to view filter options.
    2. bFrom the Include/Exclude list, choose to include or exclude metadata based on the filter parameters.
    3. cFrom the Object type list, select Path.
    4. dFrom the Filter criteria list, select Pattern.
    5. eClick Select.
    6. fIn the Select values dialog box, enter the path and click OK.
    7. Filters are not case sensitive. A single filter includes a path to a job or folder and can match multiple folders and jobs when you use wildcard characters. The root of the path starts in the Talend folder that contains the talend.project file.
      Filters can contain the following wildcard characters:
      The following image shows the filter condition options:
      The image shows the Filters area for the Talend Data Integration catalog source. You can select to include or exclude metadata from jobs or folders and enter a value to specify the object location.
    8. gTo define an additional filter with an OR condition, click the plus icon.
    9. The following image shows that the filter can include metadata from all jobs and folders within the folder 'myFolder' that start with the prefix 'data' or include metadata from all jobs within the folder 'myFolder' that start with the prefix 'Job' followed by a single character:
      The image shows the filter conditions for a Talend Data Integration catalog source that includes metadata from all jobs and folders within the folder 'myFolder' that start with the prefix 'data' or includes metadata from all jobs within the folder 'myFolder' that start with the prefix 'Job' followed by a single character.
    4In the Configuration Parameters area, enter properties to override default context values and job parameters.
    Note:
    Click
    Show Advanced
    to view all configuration parameters.
    The following table describes the properties that you can enter:
    Property
    Description
    Default Values
    Advanced parameter. Default values to provide output from the tContextLoad and tFlowToIterate components and to return values for unsupported Java methods in evaluation of Java code.
    Specify default values in the following format:
    • - [Project.Job]
    • - tUniqueName.Column1=66
    • - tUniqueName.Column2="cards"
    Examples for Java default values are:
    • - Math.function() = 0
    • - Routine.create(0) = 'text'
    Job Context Override
    Talend job and job context names to override the default context set in the *.item file.
    Click plus to add Talend jobs and job context names.
    Context Files Map
    Map the Talend context file path to a local file path so Metadata Command Center can use local copies of context files.
    Click plus to map context file paths to local file paths.
    Examples:
    • - /export/home/RootDir/talend/contextfile=C:\PrmFiles\contextfile
    • - Y:\RootDir\talend\contextfile=C:\PrmFiles\file
    • - Y:\RootDir\talend\contextfile=/export/home/RootDir/talend/contextfile
    Parameter Override
    Talend job parameter names and values to override parameter values.
    Specify a job parameter name using the job name and the parameter name separated by a colon. You can use wildcard characters '*' and '?' in the job name.
    Click plus to map job parameter names and values.
    Examples:
    • - Folder1/Folder2/job:<Parameter name>=<Parameter value>
    • - *:<Parameter name>=<Parameter value>
    5Click Next.
    The Associations page appears.

Configure lineage discovery

Enable the lineage discovery capability and use CLAIRE to build complete lineage by recommending endpoint catalog source objects to assign to reference catalog source connections.
    1Click the Lineage Discovery tab.
    2Select Enable Lineage Discovery.
    3In the Filters area, define one or more filter conditions to apply for lineage discovery.
    To define filters, you can choose to select catalog source types, asset groups, or enter a catalog source name or search from a list of catalog sources.
    1. aSelect Yes to view filter options.
    2. bFrom the Include/Exclude list, choose to include or exclude catalog sources for lineage discovery based on the filter parameters.
    3. cFrom the filter type list, select catalog source type, catalog source name, or asset group.
    4. dIn the filter value field, select the required catalog source types, or click the Search button and select catalog sources or asset groups.
    5. Filters can contain the asterisk wildcard to represent multiple characters or empty text.
      The filter options appear.The filter options include multiple filter conditions that you can choose.
      Examples:
      Note:
      You can't add more than one include or exclude filter for the same filter type.
    6. eOptionally, to define an additional filter with an AND condition, click the Add icon.
    7. For more information about lineage discovery, see Lineage discovery.