Column Profile
Create and run a column profile to determine the data source column characteristics, such as a list of values, data patterns, and value ranges. Create a column profile, and extrapolate the profile results to generate test data.
Select the columns on which you want to run a profile and configure data sampling options when you create a column profile.
After you configure and run a column profile, TDM analyzes column data and infers rules based on the data. You can view the profile results for the columns. You can manually assign the inferred rules to the columns in the profile results or apply the inferred rules that TDM provides.
You can run column profiles on Oracle and Microsoft SQL Server databases.
Inferred Rules
After you configure and run a column profile, TDM infers analyzes column data and infers rules based on the data. Column data types include all the inferred data types for each column in the profile results.
Column profile results contain the following types of inferred rules:
- Range
- The range of column values, such as the maximum and minimum lengths of values and the first and last values in each column. The range of values includes the percentage of null values in the columns. You can use rang of values for numeric and date data types.
- Patterns
- The patterns of data in each column and the percentage of distribution for each pattern. The sum of the distribution percentage must be equal to 100%. You can use data patterns for string and numeric data types.
- List of Values
- The list of unique and nonunique values in the columns and the percentage of distribution. When you assign the inferred rule type to generate test data, the sum of the distribution percentage must be equal to 100%. You can use list of values for string, numeric, and date data types.
You can assign the inferred rule type to the target columns from the Define | Data Generation page. Auto rules are the inferred rules that you assign after you run a column profile. When the status of inferred rule is Yes, you can assign Auto Rule to target columns to generate test data. You can edit the properties of the inferred rule types from the Define | Data Generation page.
Column Profile Options
You can configure the sampling options when you create or edit a column profile.
The following table describes the sampling options for a column profile:
Option | Description |
|---|
Minimum conformance percentage for patterns | Required. The minimum percentage of patterns that you want in the profile results. Default is 5. If the patterns are less than the minimum conformance percentage, TDM does not display the patterns in the profile results. |
Maximum number of rows to be profiled | Required. The maximum number of rows that you want to run the profile on. You can choose all rows in the data object or enter the number of rows that you want to profile on. Default is All. |
Minimum data coverage to show List of Values | Required. The minimum percent of data that you want in the list of values. Default is 80. If the maximum number of values that you want in the list of values is 20, then 80% of the data must contain these 20 values. |
Maximum number of values in List of Values | Required. The maximum number of values that you want in the list of values. Default is 20. |