You use a regular expression-style syntax to define the format of the input values and output tokens that Data Governance and Catalog processes when you use the tokenize data de-identification technique. Understand the limitations and follow examples of syntax that works with Data Governance and Catalog.
Note:
Since you only use the tokenization expression to define and match the format of a string, and not for extracting portions of it, the tokenization syntax that you use does not support all of the constructs available in other regular expression syntaxes.
The following are examples of what you can't use in tokenization expressions:
•Anchors
•Backreferences
•Capture groups
•Repeated elements with unbounded repetitions
•These shorthand character classes: /d, /D, /h, /H, /s, /S, /v, /V, /w, /W, and .
Follow this guide when constructing your tokenization expression.