Choose to run a catalog source job manually, or configure it to run on schedule.
Note:
You can't run multiple jobs simultaneously.
You can choose to perform a full or an incremental metadata extraction. A full metadata extraction extracts all objects from the source to the catalog. An incremental metadata extraction extracts only the changed and new objects since the last successful catalog source job run. Incremental metadata extraction doesn’t remove deleted objects from the catalog and doesn’t extract metadata of code-based objects if applicable.
When you run an incremental metadata extraction job with a filter to include metadata from objects, the job extracts only the objects that have the latest timestamp since the last successful job.
Note:
If incremental metadata extraction is available for the catalog source, the option is always visible, but incremental metadata extraction jobs can run only after a scheduled full metadata extraction job. Manual jobs do not enable the incremental metadata extraction option.
Run the job manually
Click Save to save the catalog source and click Run. On the Run Catalog Source Job window, click Run to run the job.
You can override the capabilities that you selected while configuring your catalog source on the Configuration page. The first time you run the catalog source job, the metadata extraction capability is mandatory. From the second run onwards, you can choose to override the configured metadata change option. You can retain, delete, or deprecate objects that are deleted from the source in the catalog. For subsequent runs of the catalog source job, the metadata extraction capability is optional.
Note:
You can choose incremental metadata extraction for subsequent runs only after one full metadata extraction job completes successfully. Incremental metadata extraction jobs run with the
Retain
metadata change option even if you set the option to
Delete
or
Deprecate
in the catalog source.
Note:
To run a catalog source job, you need permissions on the connection to the source system.
To run a catalog source job for catalog sources that reference other source systems, you need permissions on the connections for all the reference source systems.
Run the job on a schedule
You can choose to run metadata extraction and other capabilities on a recurring schedule. You can't choose incremental metadata extraction and full metadata extraction in the same schedule. To create a schedule for incremental metadata extraction, you must have completed at least one full metadata extraction job successfully. If not, first create a schedule for a full metadata extraction.
If an incremental metadata extraction is scheduled to run when the last run details aren't available, the job first performs a full metadata extraction, followed by incremental metadata extraction on subsequent runs.
For example, this can happen in the following scenarios:
•You create schedules for both incremental metadata extraction and full metadata extraction, but schedule the incremental extraction to run before the first full metadata extraction job.
•You create schedules for both incremental metadata extraction and full metadata extraction, but delete the full metadata extraction schedule before its first run.
1On the Schedule tab, select Run on Schedule.
The Schedule configuration page opens.
2Click the checkbox corresponding to each capability that you want to include in the schedule.
3Enter the start date, time zone, and the interval at which you want to run the job.
4You can manage additional schedules using the following options:
- To create a new schedule, click the Add button.
- To delete a schedule, click the Delete button.
- To enable or disable a schedule, click the Enable Schedule toggle button.
Note:
You can create a maximum of one schedule per capability that you enable. If you purged a catalog source or did not run the metadata extraction job, the catalog source job runs metadata extraction before running other scheduled capabilities.
Note:
To create a schedule, you need permissions on the connection to the source system. If you lose permissions on the connection after you create a schedule, the scheduled jobs continue to run.
5Click Save to save the schedule.
Monitor job status
After the job runs, you can monitor the status of the job on the Overview page of the job.