After you run a reference data import job, you can monitor and view the job details on the My Jobs page.
You can use a reference data import job to import code lists, crosswalks, and hierarchies to Reference 360. When you get started with Reference 360, you need to ingress your initial data to onboard it.
The reference data import job includes the following steps:
•Extract
•Transform
•Load
•Index for Search
Extract
The extract step extracts data from the source system to a staging area. A staging area is a temporary location where the data is stored.
If the reference data import job fails at this step or the step is in the Running status for a long time, go to the My Jobs page of Cloud Data Integration to troubleshoot. If the taskflow is in the Suspended status, view the subtasks and select the failed mapping task. Download the sessions log and check for errors.
The following table describes the metrics that you can view for the extract step:
Metric
Description
Total Records
The total number of code values and value mappings that the extract step processed.
Error Records
The number of code values and value mappings that didn't process.
Success Records
The number of code values and value mappings that the step successfully extracted from the source system.
Starting Records for Asset
The total number of code values and value mappings of crosswalks that the extract step processed for the specific asset.
Transform
The transform step applies basic and advanced rule associations to the staged data. The rule associations cleanse and transform the staged data.
If the reference data import job fails at this step or the step is in the Running status for a long time, go to the My Jobs page of Data Integration to troubleshoot. If the taskflow is in the Suspended status, view the subtasks and select the failed mapping task. Download the sessions log and check for errors.
The following table describes the metrics that you can view for the transform step:
Metric
Description
Total Records
The total number of code values and value mappings that the transform step processed.
Error Records
The number of code values and value mappings that failed the data quality rule associations.
Success Records
The number of code values and value mappings that are validated and transformed and then moved to the load step.
Starting Records for Asset
The total number of code values and value mappings that the transform step processed for the specific asset.
Load
The load step loads the cleansed code values and the value mappings into Reference 360.
If the reference data import job fails at this step or the step is in the Running status for a long time, go to the My Jobs page of Data Integration to troubleshoot. If the taskflow is in the Suspended status, view the subtasks and select the failed mapping task. Download the sessions log and check for errors.
The following table describes the metrics that you can view for the load step:
Metric
Description
Total Records
The total number of code values and value mappings that the load step processed.
Error Records
The number of code values and value mappings the step didn't process.
Success Records
The number of code values and value mappings that are loaded and moved to the index for search step.
Starting Records for Asset
The total number of code values and value mappings that the load step processed for the specific asset.
Index for Search
The index for search step indexes the code values and value mappings for search.
If the reference data import job fails at this step or the step is in the Running status for a long time, go to the My Jobs page of Data Integration to troubleshoot. If the taskflow is in the Suspended status, view the subtasks and select the failed mapping task. Download the sessions log and check for errors.
The following table describes the metrics for the index for search step:
Metric
Description
Total Records
The total number of code values and value mappings that the index for search step processed.
Error Records
The number of code values and value mappings that the step didn't process because of internal errors
Success Records
The number of code values that are indexed for search.
Starting Records for Asset
The total number of code values and value mappings that the index for search step processed for the specific asset.