Asset Name | Asset Type | Description |
---|---|---|
Delimited-File-Connection | App connection | Connection to write delimited files to the local file system. |
IDMC-Logs-Connection | App connection | Connection for IDMC logging APIs. |
IDMC Log Connector | Service connector | Service Connector that implements REST API calls to interact with the IDMC logging process. |
Load Cloud Storage Audit Mapping | Mapping | Pass-through mapping to read data from the audit logging staging area and write to a cloud storage location. This requires a separate mapping because you cannot pass in a parameter from a mapping task to override a filelist input file. |
Load Cloud Storage Security Mapping | Mapping | Pass-through mapping to load security log files from the staging area into cloud storage. This requires a separate mapping because you cannot pass in a parameter from a mapping task to override a filelist input file. |
Load Audit Logs Mapping Task | Mapping task | Mapping task that directs the Load Cloud Storage Audit mapping to load the audit logs from the staging area to the specified cloud storage location. It then calls a post-session command to clean up the staging area. |
Load Security Logs Mapping Task | Mapping task | Mapping task that directs the Load Cloud Storage Security mapping to load the security logs from the staging area to the specified cloud storage location. It then calls a post-session command to clean up the staging area. |
Get Security Log to Stage | Process | Subprocess that retrieves security log entries and writes them to a local staging file(s). The security log API can only return 1000 rows and lacks pagination support. If a full date range contains 1000 rows, it assumes that there are more entries. Consequently, it switches to fallback mode, where instead of retrieving logs for the entire date and time range at once, it repeatedly fetches smaller, segmented time intervals between the specified start and end dates. These files are then written to the staging area. |
Get Security Log | Process | Process that retrieves the log entries from IDMC and writes them to the staging location. |
Get Audit Log | Process | Process that interacts with IDMC REST APIs to retrieve audit logs and write them to the staging area. It extracts a specified number of rows defined by batchSize, filters these rows to match the specified start and end date criteria, and saves the relevant entries to a local file. The process continues to extract subsequent sets of rows, each of the batchSize, until it encounters rows that are dated earlier than the start date. |
Audit Logs Taskflow | Taskflow | Taskflow that retrieves the previous day's audit log files from the user's organization and writes them to the specified location in cloud storage. |
Security Logs Taskflow | Taskflow | Taskflow that retrieves the previous day's security log files from the user's organization and writes them to the specified location in cloud storage. |