To enrich records with additional data from data providers or to transform data in records, configure rule associations that use enrichment or transformation plugins.
You can enrich records by transforming the data within them.
To perform advanced data enrichment, you can also connect to external data providers and enrich records with the data that they return. For example, you can connect to OpenAI ChatGPT to translate the product description in an Item record.
Note: Enrichment is triggered and applied to a record even users don't have access to certain fields involved in the enrichment process.
The following table lists the plugin that you can use to configure data enrichment:
Plugin Name
Type
Service that the plugin uses
Application Integration-based Enrichment
Enrichment
Application Integration
Data Quality-based Transformation
Transformation
Data Quality
Title Case
Transformation
MDM SaaS
Concatenate
Transformation
MDM SaaS
Concatenate with Spaces
Transformation
MDM SaaS
Left Trim
Transformation
MDM SaaS
Lowercase
Transformation
MDM SaaS
Replace
Transformation
MDM SaaS
Right Trim
Transformation
MDM SaaS
Uppercase
Transformation
MDM SaaS
Note: You can't create rule associations that use MDM SaaS transformation plugins. However, you can only use predefined data enhancement rules to create rule associations. If you want to run rule associations even if all input fields are empty, you can create rule associations with transformation plugins.
Application Integration-based Enrichment plugin
To enrich records with data from external data providers, use the Application Integration-based Enrichment plugin and configure data enrichment.
When a rule association with a data enhancement rule that uses this plugin is triggered, the input fields are sent to an Application Integration process, which connects to an external data provider. When the data provider returns data for enrichment, you can automatically enrich or assign records to a hierarchy. You can also display the enrichment data as recommendations in business applications.
When you configure data enrichment, you can choose to enrich specific fields of records. For example, you can send a product description to an external data provider and extract the brand name from the description.
You can also add records to hierarchies based on the data from an external data provider. For example, to assign product records to a hierarchy, you can send a product description to an AI-powered external data provider to get relevant product categories. Based on the product categories that the data provider returns and the existing category records, you can either directly assign the records to a hierarchy or present the category records as recommendations to users.
The following table lists the properties of the plugin:
Property
Description
CAI Process Identifier
Identifier of the Application Integration process that the plugin uses.
CAI Process Name
The API name of the process that's specified in the CAI Process Identifier property.
Accept Threshold
The confidence score above which data from the data provider is automatically accepted and applied. To enable rule associations to enrich records automatically, enter 0 in the Accept Threshold and Reject Threshold fields. To display the information from the data provider as CLAIRE recommendations, specify the accept and reject thresholds with a value greater than 0.
The name of the field that contains the confidence scores from the data provider. To display the confidence scores along with the recommendations in business applications, specify the name of the field. You can get the field name from the Output Fields tab. If you don't specify the name of the field that contains the confidence scores, CLAIRE displays all recommendations without applying the accept and reject thresholds.
Include only new or updated field group entries
Determines whether the input payload includes only new or updated field group entries. To send all entries of a field group to the Application Integration process, disable the property. For example, if you want to ensure that a record has at least one address entry, disable this property so that the validation service can count the entries in the Address section.
Note: When you enable the option to include only new or updated field group entries in the payload, the associated rule association runs only if users add or update entries for the mapped field groups. It doesn’t run even if users add or update a value only in an input root field without adding or updating the field group entries.
Run the selected process even when all input fields are empty
Indicates whether to run the Application Integration process when all input fields are empty. By default, when all input fields are empty, the status of the rule association is automatically set to successful without running the Application Integration process.
Determining the data enrichment type
When you configure Application Integration-based enrichment, you can configure to enrich records automatically or to provide CLAIRE recommendations to the user.
When you configure a rule association to provide CLAIRE recommendations, CLAIRE displays enrichment data as recommendations that are based on confidence scores from data providers. When you configure data enrichment, you can set accept and reject thresholds in a data enhancement rule.
For example, you can send a product description to an AI-powered data provider and request the data provider to suggest brand names based on the description. When the data provider suggests multiple names for a brand, CLAIRE displays the suggestions that fall within the Accept and Reject thresholds as recommendations.
The following image shows how the accept and reject thresholds impact the recommendations from a data provider:
•If you set the accept and reject thresholds to zero, the data from the data provider is automatically accepted and applied.
•If the confidence score is above the accept threshold, the data from the data provider is automatically accepted and applied.
Note: If the response from the data provider contains multiple recommendations for a field group, each recommendation is added to the record as a separate field group entry. However, if the recommendations are for a root field, the value from the last recommendation survives. If the data for hierarchy assignment contains multiple recommendations, multiple relationships are created based on the recommendations.
•If the confidence score is within the accept and reject thresholds, CLAIRE displays recommendations in business applications for users to accept or reject them. CLAIRE sorts the recommendations by confidence scores and displays them in descending order.
•If you specify an accept threshold value greater than zero and the response from the data provider doesn't contain confidence scores, CLAIRE displays all the recommendations.
Data enrichment configuration scenario
You work for Acme and want to manage its product information on Amazon. You want to translate the English descriptions of products into French for the customers in France after business users create Item records. To ensure that the products listed on Amazon reflect the correct product classification, you also want to automatically classify the records.
To translate English product descriptions into French, design a custom process named Translate Product Description in Application Integration. Design the process to send English product descriptions to OpenAI ChatGPT for translation. Additionally, design a process named Product Classification for Amazon to connect to an external service that provides product categories based on product descriptions.
The following image shows how two Application Integration processes connect to two external services:
In Business 360 Console, you create an objective group named Enrich Production Information on Amazon. Within the objective group, you define objectives named Enrich Brand Information and Classify Products.
In the Enrich Brand Information objective, you create a rule association named Translate description to French with a data enhancement rule named Translation rule. You configure this rule association to send product descriptions to the Translate Product Description process and to update the Item records with the translated descriptions that ChatGPT returns.
The following image shows a sample data enrichment configuration for Acme Pvt Ltd:
Similarly, create a rule association named Mappings for Product Classification within the Classify Products objective. You can configure the rule association to send product descriptions to the Classify Products for Amazon process. Also, you configure the rule association to classify the Item records based on the product categories that the process returns.
Title Case
To apply uppercase to the first letter followed by lowercase, use the Title Case plugin.
MDM SaaS includes the Title Case predefined data enhancement rule. Instead of creating a new data enhancement rule with the Title Case plugin, you can use the predefined rule data enhancement rule that contains an input and output field.
You can map the input and output fields to the required business entity fields.
For example, you can transform the product name business entity field value to title case format. To transform the field value to title case, create a rule association by using the Title Case predefined data enhancement rule. You can map the input field of the data enhancement rule to the product name business entity field and the output field of the data enhancement rule to the product name business entity field. When you enter the value of the product name business entity field as oneplus, MDM SaaS transforms the input value to Oneplus.
If you want to run the rule association even if all input fields are empty, you must create a data enhancement rule that uses the Title Case plugin.
The following table describes the properties of the Title Case plugin:
Property
Description
Run rule associations even if all input fields are empty
Enable this property to run the rule association even if none of the input fields contain any value.
Concatenate
To concatenate two or more strings without spaces, use the Concatenate plugin.
You can select the predefined Concatenate without Spaces data enhancement rule to concatenate values from two input field without spaces between them. The predefined Concatenate without Spaces data enhancement rule contains two input fields, such as Field 1 and Field 2 of text data type. You can map the corresponding business entity fields to the input and output business entity fields.
By default, the predefined Concatenate without Spaces data enhancement rule contains one output field. MDM SaaS concatenates the data in the two business entity input fields and returns the output to the mapped business entity field.
For example, to concatenate the first name and last name fields and return the output to the username field, map the two business entity fields to the input fields. You can map the output field to the username business entity field.
If you want to run the rule association even if all input fields are empty, you must create a data enhancement rule with the Concatenate without Spaces plugin.
The following table describes the properties of the Concatenate without Spaces plugin:
Property
Description
Run rule associations even if all input fields are empty
Enable this property to run the rule association even if none of the input fields contain any value.
Number of Input fields
Total number of input field values that you want to concatenate without spaces.
Concatenate with Spaces
To concatenate two or more strings with spaces between them, use the Concatenate with Spaces plugin.
MDM SaaS includes two predefined data enhancement rules, such as Concatenate with Spaces and Concatenate Three Values with Spaces. The Concatenate with Spaces rule association concatenates values from two input fields with spaces between them. However, the Concatenate Three Values with Spaces rule association concatenates values from three input fields with spaces between them.
The predefined Concatenate Three Values with Spaces data enhancement rule contains the following iput fields of the text data type:
•Field1
•Field2
•Field3
For example, to concatenate values of the first name, middle name, and last name fields and return the output to the full name field, map the input fields to the first name, middle name, and last name business entity fields. You can then map the output field of the data enhancement rule to the full name business entity field.
If you want to run the rule association even if all input fields are empty, create a data enhancement rule with the Concatenate with Spaces plugin.
The following table describes the properties of the Concatenate with Spaces plugin:
Property
Description
Run rule associations even if all input fields are empty
Enable this property to run the rule association even if none of the input fields contain any value.
Number of Input fields
Total number of input field values that you want to concatenate with spaces.
You can use the Concatenate with Spaces plugin and create data enhancement rules based on the number of input fields.
Data Quality - Transformation
To use the rule specification from Data Quality for transforming input data, use the Data Quality - Transformation plugin.
Based on the rule logic configured in the rule specification in Data Quality, MDM SaaS transforms the data.
The following table describes the properties of the Data Quality - Transformation plugin:
Property
Description
Rule Specification
Rule specification configured in Data Quality.
Run rule associations even if all input fields are empty
Enable this property to run the rule association even if none of the input fields contain any value.
You can view input fields that are defined in rule specifications in Data Quality and map the business entity fields to it. The predefined output field is the primary rule set that displays the output of the rule association.
Left Trim
To remove spaces from the beginning of a string, use the Left Trim plugin.
MDM SaaS includes the Left Trim predefined data enhancement rule. The predefined Left Trim data enhancement rule uses an input field and an output field. You can map the corresponding business entity fields to the input and output fields.
For example, to remove the leading space in the first name " John", map the first name business entity field to the input field. You can map the output field to the first name business entity field. When the rule association runs, it removes the leading space from the value and returns the output as "John".
If you want to run the rule association even if all input fields are empty, you must create a data enhancement rule with the Left Trim plugin.
The following table describes the properties of the Left Trim plugin:
Property
Description
Run rule associations even if all input fields are empty.
Enable this property to run the rule association even if none of the input fields contain any value.
Lowercase
To convert uppercase string to lowercase, use the Lowercase plugin.
MDM SaaS includes the Lowercase predefined data enhancement rule. The predefined Lowercase data enhancement rule uses an input and an output field. You can map the corresponding business entity fields to the input and output fields.
For example, to convert the last name business entity field value to lowercase, map the last name business entity field to the input field. You can map the output field to the last name business entity field. When the rule associations runs, it transforms the last name to lowercase and returns the output.
If you want to run the rule association even if all input fields are empty, you must create a data enhancement rule with the Lowercase plugin.
The following table describes the properties of the Lowercase plugin:
Property
Description
Run rule associations even if all input fields are empty.
Enable this property to run the rule association even if none of the input fields contain any value.
Replace
To replace a character set in a string with another character set, use the Replace plugin.
MDM SaaS includes the Replace predefined data enhancement rule.
The predefined Replace data enhancement rule contains the following input fields of the text data type:
•Input
•Old String
•New String
You can map the corresponding business entity fields to the input and output fields.
If you want to run the rule association even if all input fields are empty, you must create a data enhancement rule with the Replace plugin.
The following table describes the properties of the Replace plugin:
Property
Description
Run rule associations even if all input fields are empty.
Enable this property to run the rule association even if none of the input fields contain any value.
Case sensitive
Specifies whether to consider case sensitivity when validating input values.
Right Trim
To remove spaces at the end of a string, use the Right Trim plugin.
MDM SaaS includes the Right Trim predefined data enhancement rule. The predefined Right Trim data enhancement rule uses an input and an output field of the text data type. You can map the corresponding business entity fields to the input and output fields.
For example, to remove trailing spaces from the employee ID business entity field, map the employee ID business entity field to the input field. You can map the output field to the employee ID business entity field. When the rule associations runs, it removes the trailing spaces from the employee ID business entity field.
If you want to run the rule associations even if all input fields are empty, create a data enhancement rule with the Right Trim plugin.
The following table describes the properties of the Right Trim plugin:
Property
Description
Run rule associations even if all input fields are empty.
Enable this property to run the rule association even if none of the input fields contain any value.
Uppercase
To convert lowercase string to uppercase, use the Uppercase plugin.
MDM SaaS includes the Uppercase predefined data enhancement rule. The predefined Uppercase data enhancement rule uses an input and an output field of the text data type. You can map the corresponding business entity fields to the input and output fields.
For example, to transform the value of the first name business entity field to uppercase, map the first name business entity field to the input field. You can map the output field to the first name business entity field. When the rule associations runs, it transforms the value of the first name business entity field to uppercase.
If you want to run the rule association even if all input fields are empty, create a data enhancement rule with the Uppercase plugin.
The following table describes the properties of the Uppercase plugin:
Property
Description
Run rule associations even if all input fields are empty.
Enable this property to run the rule association even if none of the input fields contain any value.
