Token Parsing Operations
In token parsing mode, the Parser transformation parses strings that match data in token sets, regular expressions, probabilistic models, or reference table entries.
To perform token parsing, add strategies on the Strategies view of the transformation. You can add one or more operations to each strategy. The transformation provides a wizard that you use to create strategies.
You can add the following types of operations to a token parsing strategy:
- Parse using Token Set
- Use predefined or user-defined token sets to parse input data. Token set operations can use custom regular expressions that write data to one or more outputs.
- You can also use probabilistic models to identify and parse input data values.
- Parse using Reference Table
- Use reference tables to parse input data.
The transformation performs the operations in the order in which they appear in the strategy.