If your organization uses Metadata Command Center and you use a catalog source object, CLAIRE might recommend an Expression transformation to help you standardize your source data.
Before CLAIRE can recommend Expression transformations, you must run a profiling job on the catalog source in Metadata Command Center. Then, when you select the catalog source as your source object in the mapping, CLAIRE recommends Expression transformations based on the attributes of the source fields.
CLAIRE might recommend Expression transformations to replace NULL values or to standardize date type formats.
Replace NULL values
If CLAIRE detects a large number of fields with NULL values in the source, it might recommend an Expression transformation that replaces the NULL values with a value that you define.
CLAIRE recommends that you replace NULL values when NULL appears in more than 85% of the column fields. When a recommendation is available, Data Integration highlights the Recommendations tab. Select the Recommendations tab to see the recommendations.
In the list of recommendations, click the Show Me icon for the expression that you want to investigate and then enter a preview value. An Expression transformation appears on the mapping canvas linked to the associated source.
If you want to use the expression, in the Recommendations tab, click the Accept icon. Then, enter the value you want to use in place of NULL. In the mapping canvas, connect the Expression transformation to the data flow.
If you don't enter a value, CLAIRE replaces NULL values with a default value based on the data type. The following table shows the default values CLAIRE uses:
Data type
Default value
String
default
Integer
Bgint
0
Date
Current system time
Decimal
Double
0.0
Binary
0
If you don't want to use the recommended expression, click Decline. Data Integration removes the recommended Expression transformation from the mapping canvas.
Date type standardization
If CLAIRE detects multiple date formats in the source, it might recommend an Expression transformation that converts all date type fields to a common format.
The date format that CLAIRE recommends is the format occurring most frequently in the column fields. CLAIRE recommends a date format when it occurs in more than 85% of the column fields.
When a recommendation is available, Data Integration highlights the Recommendations tab. Select the Recommendations tab to see the recommendations.
In the list of recommendations, click the Show Me icon for the expression that you want to investigate. An Expression transformation appears on the mapping canvas linked to the associated source.
If you want to use the expression, in the Recommendations tab, click the Accept icon. In the mapping canvas, connect the Expression transformation to the data flow.
If you don't want to use the recommended expression, click Decline. Data Integration removes the recommended Expression transformation from the mapping canvas.