Configuring Monitoring
You can configure the domain to display statistics and reports about objects in the domain. Statistics and reports appear in the History view on the Manage tab and in the Summary Statistics and Execution Statistics views on the Monitor tab. To view statistics and reports, you must configure monitoring for the domain.
When you configure monitoring in the domain, the Data Integration Services store statistics and reports in a Model repository. The statistics include historical information about objects that the Data Integration Services run. The reports show key metrics about integration objects.
If you do not configure monitoring, then some views on the Manage and Monitor tabs do not have content. The workflow graph is also empty, and notifications disappear when you refresh the page.
To set up monitoring statistics and reports, perform the following tasks:
- 1. Configure monitoring settings. Configure a Model repository to store run-time statistics for objects that the Data Integration Services run.
- 2. Configure reports and statistics views. Choose which statistics appear in the Statistics and Reports views.
Note: In a domain that uses Kerberos authentication, users must have the Administrator role for the Model Repository Service that stores statistics. If users do not have Administrator role, then some statistics do not appear.
Step 1. Configure Monitoring Settings
Configure monitoring settings for the domain when you want to view historical information about the domain. When you configure monitoring settings, you specify a Model repository to store run-time statistics about objects that the Data Integration Services run.
Create the Model repository contents before you configure the monitoring settings. If you create the contents after you configure the monitoring settings, then you must recycle the Model Repository Service after the contents are created.
1. In the Administrator tool, click the Manage tab > Services and Nodes view.
2. Click the Monitoring Configuration view.
The current monitoring configuration displays.
3. Click Edit to change the monitoring configuration.
4. Edit the following options:
Option | Description |
---|
Model Repository Service | Name of the Model repository that stores the historical information. The Model repository must not be integrated with a version control system. |
Username | User name to access the Model Repository Service. Does not appear in domains that use Kerberos authentication. |
Password | Password of the user name to access the Model Repository Service. Does not appear in domains that use Kerberos authentication. |
Modify Password | Modify the Model Repository Service password. |
Security Domain | Name of the security domain that the Model repository user belongs to. |
Preserve Summary Historical Data | Number of days that the Model repository saves averaged data. If purging is disabled, then the Model repository saves the data indefinitely. Default is 180. Minimum is 0. Maximum is 366. |
Preserve Detailed Historical Data | Number of days that the Model repository saves per-minute data. If purging is disabled, then the Model repository saves the data indefinitely. Default is 14. Minimum is 1. Maximum is 14. |
Purge Statistics Every | Interval, in days, at which the Model Repository Service purges data that is older than the values configured in the Preserve Historical Data option. Default is 1 day. |
Days At | Time of day when the Model Repository Service purges statistics. Default is 1:00 a.m. |
Maximum Number of Sortable Records | Maximum number of records that can be sorted in the Monitor tab. If the number of records on the Monitor tab is greater than this value, then you can only sort by Start Time and End Time. Default is 3,000. |
Maximum Delay for Update Notifications | Maximum time, in seconds, that the Data Integration Service buffers statistics before it stores them in the Model repository and displays them in the Monitor tab. If the Data Integration Service shuts down unexpectedly before it stores the statistics in the Model repository, then the statistics are lost. Default is 10. |
Show Milliseconds in Date Time Field | Include milliseconds for date and time fields in the Monitor tab. |
5. Click OK.
6. Click Save.
To apply the settings, you must restart all of the Data Integration Services.
Step 2. Configuring Reports and Statistics Views
By default, the Statistics and Reports views on the Execution Statistics view are empty. To view statistics and reports, you must configure the Report and Statistic settings in the domain. These settings apply to all Data Integration Services in the domain.
Before you configure statistics and reports, you must specify a Model Repository Service in the Monitoring Configuration and enable the Model Repository Service.
1. In the Administrator tool, click the Monitor tab.
2. Click Actions > Report and Statistic Settings.
3. On the Statistics tab, configure the time ranges that you want to use for statistics, and then select the frequency at which the statistics assigned to each time range should be updated.
4. Select a default time range to appear for all statistics.
5. Click the Reports tab.
6. Enable the time ranges that you want to use for reports, and then select the frequency at which the reports assigned to each time range should be updated.
7. Select a default time range to appear for all reports, and then click OK.
8. Click Select Reports.
9. Add the reports that you want to run to the Selected Reports box.
10. Organize the reports in the order in which you want to view them on the Monitor tab.
11. Click OK to close the Select Reports window.
12. Click OK to the settings and close the Report and Statistic Settings window.
Optimizing Monitoring Performance
When you configure monitoring in the domain, you configure a Model repository to store monitoring statistics. You also configure how often the Model Repository Service purges statistics. You can configure the repository database and purge settings to minimize resource consumption and maximize monitoring performance.
To optimize monitoring performance, enable the Purge Statistics option in the Monitoring Configuration. When you enable statistics purging, you configure how often the Model Repository Service purges data. Use the Preserve options in the Monitoring Configuration to configure how long Detailed and Summary data are saved in the Model repository before they are purged.
For optimum monitoring performance, consider the following guidelines when you configure the domain for monitoring:
- •Create a Model Repository Service that is dedicated to storing monitoring data. Specify this Model Repository Service when you configure monitoring in the domain.
- •Verify that the Model repository database is tuned properly.
- •Purge monitoring data during off-hours to limit the impact on other database operations.
- •Purge monitoring data daily.