Log Collection Utilities
Enterprise Data Catalog provides utilities that you can use to collect logs from Enterprise Data Catalog services and specific resources.
You can collect logs to analyze and troubleshoot issues related to services and resources if they do not work as expected. The utilities do not require you to stop the services or resources when the logs are collected.
After you run the utilities to collect the logs, make sure that you download the logs within 24 hours. The logs are removed from the directory after 24 hours. Also, if you recycle the Catalog Service after you run the REST APIs, the logs are removed from the directory.
Collect Enterprise Data Catalog Service Logs
You can collect Enterprise Data Catalog service logs to identify and troubleshoot issues related to Enterprise Data Catalog services. You can use the Collect Service Logs page to collect the resource logs.
To collect service logs, perform the following steps:
- 1. Click Collect Service Logs on the left panel. The Collect Service Logs page appears.
- 2. From Select Logs, choose any or all of the following services for which you want to collect the logs:
- - HBase. Select if you want to collect logs related to Apache HBase. Enterprise Data Catalog uses Apache HBase as the database for ingesting data.
- - Solr. Select if you want to collect logs related to Apache Solr. Enterprise Data Catalog uses Apache Solr to search for data assets.
- - Ingestion. Select if you want to collect logs related to the ingestion service.
- - Service. Select if you want to collect all logs related to the Catalog Service.
- - All. Select if you want to collect logs for all the above listed services.
- 3. From the Start Date box, select the date from which you want to collect the service logs.
- 4. From the End Date box, select the date till which you want to collect the service logs.
- 5. Click Download. The Monitoring Job Details page appears from where you can download the log file.
After you download and extract the log files, the log files are located in the following directories:
- •HBASE. Includes the Apache HBase logs.
- •SOLR. Includes the Apache Solr logs.
- •INGESTION. Includes the ingestion service logs.
- •LDM. Includes all the Catalog Service logs.
Collect Resource Logs
You can collect specific resource YARN logs and Data Integration logs for profiling to identify and troubleshoot issues related to resources. You can use the Collect Resource Logs page to collect the logs.
To collect resource logs, perform the following steps:
- 1. Click Collect Resource Logs on the left panel. The Collect Resource Logs page appears.
- 2. Select SCANNER, PROFILING, or both the options to collect the logs. You can choose the Profiling option only in Enterprise Data Catalog version 10.4.1.1.
- 3. From the Start Date box, select the date from which you want to collect the logs for the resource.
- 4. In the Resource box, specify the name of the resource for which you want to collect the log files.
- 5. Click Download. The Monitoring Job Details page appears from where you can download the log file.
After you download and extract the log files, the resource log files appear in the <resource name> directory in the Informatica logs directory.
Note: If you configure the LdmCustomOptions.ldm.exclusive.mode custom property to true for the Catalog Service, the service collects only the resource YARN logs. If you configure the property to false, the service collects resource YARN logs and Data Integration logs for profiling. Recycle the Catalog Service after you change the custom property.
To configure this property, navigate to the Informatica Administrator > Manage > Services and Nodes > Catalog Service > Custom Properties section.