Catalog Administrator Guide > Monitoring Enterprise Data Catalog > Monitoring by Resource
  

Monitoring by Resource

After scanners start extracting metadata from resources, you can monitor the resource statistics in the Monitoring tab. You can view a consolidated summary of resources with different task statuses.
The monitoring statistics include resource schedule, task type, task status, and the details of the scheduled next run. You might want to monitor specific resources based on certain conditions. For example, view the resources that contributed to the metadata extraction for the last 12 hours or resources that had failed tasks as part of troubleshooting issues. Use the filters on the Monitoring tab to view specific resource statistics.

Monitoring Profiles

When you enable data discovery and run a resource, the profiling scanner performs the Profile Run job. In the Monitoring tab, when you select the Profile Run job, the Logs section displays the statistics and progress of the profile run.
When you run a resource, the profiling scanner performs the following validation steps:
Data Integration Validation
  1. 1. Verify that the Data Integration Service configured for the resource is enabled.
  2. 2. Verify that the profiling warehouse has been properly configured.
  3. 3. Verify that the profiling warehouse connection is properly configured.
Profile Validation
  1. 1. Chooses a random data source in the resource to run the profile on. If the profile run is successful, the scanner continues to run the profile on the rest of the data sources.
  2. 2. If the profile run fails on the first data source, the profiling scanner proceeds to choose another random data source to run the profile on. If the profile run is successful, the scanner continues to run the profile on the rest of the data sources.
  3. 3. If the profile run fails on the first and second data sources, the profiling scanner proceeds to choose another random data source in the resource to run the profile on. If the profile run is successful, the scanner continues to run the profile on the rest of the data sources.
If the profile run fails for all the three data sources, the scanner stops the Profile Run job and the Profile Validation property in the Statistics and Progress tabs display the Validatation failed value.
When the validation fails, click the Log URL for to view the validation summary in the profile scanner application log to verify the reason for validation failure.