Big Data Management User Guide
>
Processing Unstructured and Semi-structured Data with an Intelligent Structure Model
> Checking for Data Loss
Checking for Data Loss
To verify if a mapping with an
Intelligent structure model
lost data when it processed an input file, check the Spark history log.
To get the log, run the following command on the Spark engine host machine:
yarn logs -applicationId<application ID>
To get the log, run the following command on the Spark engine host machine: To get the log, run the following command on the Spark engine host machine: