IDMC System Log Capture > IDMC System Log Capture recipe contents > IDMC System Log Capture recipe assets
  

IDMC System Log Capture recipe assets

The following table lists the assets that the IDMC System Log Capture recipe package contains:
Asset Name
Asset Type
Description
Delimited-File-Connection
App connection
Connection to write delimited files to the local file system.
IDMC-Logs-Connection
App connection
Connection for IDMC logging APIs.
IDMC Log Connector
Service connector
Service Connector that implements REST API calls to interact with the IDMC logging process.
Load Cloud Storage Audit Mapping
Mapping
Pass-through mapping to read data from the audit logging staging area and write to a cloud storage location. This requires a separate mapping because you cannot pass in a parameter from a mapping task to override a filelist input file.
Load Cloud Storage Security Mapping
Mapping
Pass-through mapping to load security log files from the staging area into cloud storage. This requires a separate mapping because you cannot pass in a parameter from a mapping task to override a filelist input file.
Load Audit Logs Mapping Task
Mapping task
Mapping task that directs the Load Cloud Storage Audit mapping to load the audit logs from the staging area to the specified cloud storage location. It then calls a post-session command to clean up the staging area.
Load Security Logs Mapping Task
Mapping task
Mapping task that directs the Load Cloud Storage Security mapping to load the security logs from the staging area to the specified cloud storage location. It then calls a post-session command to clean up the staging area.
Get Security Log to Stage
Process
Subprocess that retrieves security log entries and writes them to a local staging file(s). The security log API can only return 1000 rows and lacks pagination support. If a full date range contains 1000 rows, it assumes that there are more entries. Consequently, it switches to fallback mode, where instead of retrieving logs for the entire date and time range at once, it repeatedly fetches smaller, segmented time intervals between the specified start and end dates. These files are then written to the staging area.
Get Security Log
Process
Process that retrieves the log entries from IDMC and writes them to the staging location.
Get Audit Log
Process
Process that interacts with IDMC REST APIs to retrieve audit logs and write them to the staging area. It extracts a specified number of rows defined by batchSize, filters these rows to match the specified start and end date criteria, and saves the relevant entries to a local file. The process continues to extract subsequent sets of rows, each of the batchSize, until it encounters rows that are dated earlier than the start date.
Audit Logs Taskflow
Taskflow
Taskflow that retrieves the previous day's audit log files from the user's organization and writes them to the specified location in cloud storage.
Security Logs Taskflow
Taskflow
Taskflow that retrieves the previous day's security log files from the user's organization and writes them to the specified location in cloud storage.