The generate tokens step generates match keys for all the records. Currently, the step uses SSA-NAME3 algorithm to generate match keys. The TF-IDF algorithm is not available in the current release.
If a generate search indexes or match keys job fails at this step, verify the match model configuration.
The following table lists the metrics that you can view for the generate tokens step:
Metric
Description
Total Records
The total number of records for which the step generated match keys.
Error Records
The number of records for which the step didn't generate match keys because of internal errors.
Success Records
The number of records for which match keys are generated.
Starting Records for Asset
The total number of records that the step processed for a specific asset.