Configuring Monitoring
To monitor a mass ingestion specification, you must configure the domain to display statistics and reports about objects in the domain.
When you configure monitoring in the domain, the Data Integration Services that run mass ingestion specifications store statistics and reports in a Model repository. The statistics include historical information about objects that the Data Integration Services run.
If you do not configure monitoring, some views on the Manage and Monitor tabs do not have content. The workflow graph is empty, and notifications disappear when you refresh the page. You cannot monitor the mapping jobs that perform the mass ingestion job and you cannot monitor the ingestion status in the Mass Ingestion tool.
To set up monitoring statistics and reports, perform the following tasks:
- 1. Configure monitoring settings. Configure a Model repository to store run-time statistics for objects that the Data Integration Services run.
- 2. Configure reports and statistics views. Choose which statistics appear in the Statistics and Reports views.
Step 1. Configure Monitoring Settings
Configure monitoring settings for the domain. When you configure monitoring settings, you specify a Model repository to store run-time statistics about deployed mass ingestion specification on the Data Integration Service.
Create the Model repository contents before you configure the monitoring settings. If you create the contents after you configure the monitoring settings, then you must recycle the Model Repository Service after the contents are created.
1. In the Administrator tool, click the Manage tab > Services and Nodes view.
2. Click the Monitoring Configuration view.
The current monitoring configuration displays.
3. Click Edit to change the monitoring configuration.
4. Edit the following options:
Option | Description |
|---|
Model Repository Service | Name of the Model repository that stores the historical information. The Model repository must not be integrated with a version control system. |
Username | User name to access the Model Repository Service. |
Password | Password of the user name to access the Model Repository Service. |
Modify Password | Modify the Model Repository Service password. |
Security Domain | Name of the security domain that the Model repository user belongs to. |
Preserve Summary Historical Data | Number of days that the Model repository saves averaged data. If purging is disabled, then the Model repository saves the data indefinitely. Default is 180. Minimum is 0. Maximum is 366. |
Preserve Detailed Historical Data | Number of days that the Model repository saves per-minute data. If purging is disabled, then the Model repository saves the data indefinitely. Default is 14. Minimum is 1. Maximum is 14. |
Purge Statistics Every | Interval, in days, at which the Model Repository Service purges data that is older than the values configured in the Preserve Historical Data option. Default is 1 day. |
Days At | Time of day when the Model Repository Service purges statistics. Default is 1:00 a.m. |
Maximum Number of Sortable Records | Maximum number of records that can be sorted in the Monitor tab. If the number of records on the Monitor tab is greater than this value, then you can only sort by Start Time and End Time. Default is 3,000. |
Maximum Delay for Update Notifications | Maximum time, in seconds, that the Data Integration Service buffers statistics before it stores them in the Model repository and displays them in the Monitor tab. If the Data Integration Service shuts down unexpectedly before it stores the statistics in the Model repository, then the statistics are lost. Default is 10. |
Show Milliseconds in Date Time Field | Include milliseconds for date and time fields in the Monitor tab. |
5. Click OK.
6. Click Save.
To apply the settings, you must restart all of the Data Integration Services.
Step 2. Configure Reports and Statistics
By default, the ingestion job statistics for a mass ingestion specification are empty in the Mass Ingestion tool. To view statistics and reports, you must configure the Report and Statistic settings in the domain. These settings apply to all Data Integration Services in the domain.
Before you configure statistics and reports, you must specify a Model Repository Service in the Monitoring Configuration and enable the Model Repository Service.
1. In the Administrator tool, click the Monitor tab.
2. From the Actions menu, select Report and Statistic Settings.
3. On the Statistics tab, configure the time ranges that you want to use for statistics, and then select the frequency at which the statistics assigned to each time range should be updated.
4. Select a default time range to appear for all statistics.
5. Click the Reports tab.
6. Enable the time ranges that you want to use for reports, and then select the frequency at which the reports assigned to each time range should be updated.
7. Select a default time range to appear for all reports, and then click OK.
8. Click Select Reports.
9. Add the reports that you want to run to the Selected Reports box.
10. Organize the reports in the order in which you want to view them on the Monitor tab.
11. Click OK to close the Select Reports window.
12. Click OK to the settings and close the Report and Statistic Settings window.