Step 6. Monitor Data Lake Usage
As analysts use the Intelligent Data Lake application to prepare data in the data lake, you can regularly monitor the usage and activity on the data lake.
You can monitor the following activities:
- Hadoop jobs that run in the Hadoop cluster when analysts upload and publish data
- During the upload and publishing process, the Data Integration Service runs mappings in the Hadoop environment. The Data Integration Service pushes the processing to nodes in the Hadoop cluster. You can monitor the mappings that run during the upload and publishing processes on the Monitor tab of the Administrator tool. The mappings are listed as ad hoc jobs on the Monitor tab. For more information about monitoring mappings in a Hadoop environment, see the Informatica Big Data Management Guide.
- Events that the Intelligent Data Lake Service writes to HBase in the Hadoop cluster
- You can audit user activity on the data lake by viewing the events that the Intelligent Data Lake Service writes to HBase. The events include user activity in the Intelligent Data Lake application, such as when a user creates a project, adds data assets to a project, or publishes prepared data.
Tools to complete this step:
- •Informatica Administrator
- •Third-party reporting tools