New Features and Enhancements for Version 10.1.0
This section describes the new features and enhancements for version 10.1.0.
Data Generation Rules
To generate test data, you can create the following types of generation rules:
- Advanced Generation Rule
- An advanced generation rule is a combination of generation techniques that generates test data in target columns based on the configuration of one or more than one input port, variable port, and output port. You can generate test data for string, numeric, and date data types. When you create an advanced rule, create input ports, variable ports, and output ports to generate data as per the requirements.
- Credit Card Generation Rule
- Use a credit card generation rule to generate credit card numbers based on the issuing credit card network. You can select the credit card issuer type that you want to generate, specify the starting numbers for the card, and the distribution percentage.
- You can generate test data for the following issuing networks: American Express, Discover, JCB, Mastercard, and Visa.
- You can generate credit card numbers for string data types.
- You cannot generate credit card numbers for numeric, date, and binary data types.
- Conditional Generation Rule
- A conditional generation rule is an ad hoc rule in which you can specify a conditional expression and a generation rule to generate test data. You can use the string, numeric, and date data types in a conditional generation rule.
- You cannot apply conditions on effective dates and sequence generation rules.
For information about how to create and use the data generation rules, see the Test Data Management 10.1.0 User Guide.
Blaze Execution Engine
You can select an execution engine to run the mappings for a Hadoop connection.
Select a Blaze execution engine at the plan level or from the Administrator | Preferences view. TDM prioritizes the plan-level settings when you run the plan in the Hadoop environment.
If you select the Blaze execution engine, Blaze uses an internal workflow compiler to run the mapping. Use a Blaze engine to improve the speed and performance of the task.
For information about the Blaze execution engine, see the Test Data Management 10.1.0 User Guide.
Avro and Parquet Data Sources
Avro and Parquet are semi-structured data sources.
When you select an HDFS target connection, use Avro or Parquet resource formats to mask data and to move data in groups. You can select the resource format at the plan level.
For information about Avro and Parquet data sources, see the Test Data Management 10.1.0 User Guide.
Single Masking Rule Assignment
You can assign a single masking rule, a policy, or both to multiple columns of similar data type.
You can search for column names with similar data type. Assign a single rule or a policy to all the selected columns at once instead of individual assignment to each column.
For information about how to assign a single rule to multiple columns, see the Test Data Management 10.1.0 User Guide.
Advanced Search Text Filter
In Test Data Manager, you can enter a text instead of the wild characters in the filter criteria to search for columns.
Based on the type of filter operators, TDM searches and displays the results.
You can use the following types of filters: exact match, starts with, ends with, and contains
For information about how to use advanced search text filter, see the Test Data Management 10.1.0 User Guide.
Oracle Data Source Import
If you import data sources from an Oracle database, you can choose to ignore the tables that do not contain any data.
Test Data Manager excludes all the empty tables in the Oracle database and lists the tables that contain data.
For information about how to import Oracle data source without empty tables, see the Test Data Management 10.1.0 User Guide.
Data Coverage Analysis
You can create data coverage tasks to analyze test data in a data set.
Create a data coverage task to analyze values in a combination of two columns. You can add up to two filter columns to configure the scope of the analysis. Change the combinations of data to verify that a data set contains data required for specific test cases. You can update data across combinations of columns to add data where there might not be sufficient data density.
For information about how to perform data coverage analysis, see the Test Data Management 10.1.0 User Guide.
View and Edit Data in a Data Set
You can view and edit the data in a data set from Test Data Manager.
View and manage data from the data set page. You can add, delete, or update data in the data set. You can use SQL queries to perform these tasks or directly update the data in the grid. Add row-level tags to the data set to track changes or mark specific rows. You can perform a keyword search based on row-level tags.
For information about how to view and edit data in a data set, see the Test Data Management 10.1.0 User Guide.
Related Data Sets
You can create a related data set from an existing data set.
The related data set contains a subset of the data in the original data set. Create a related data set when you want to separately store and use a specific chunk of the data in a data set.
For information about how to create a related data set, see the Test Data Management 10.1.0 User Guide.
Subset Data Set Commands
To create a subset of a data set, you can use the following ilmcmd commands:
- •ListPlans. Lists all the plans within a data set version.
- •TDWPlanGenerate. Generates a workflow to create a subset of a data set.
- •TDWPlanExecute. Runs a plan to create a subset of a data set.
- •TDWPlanGenExe. Generates and runs a data set subset plan from a data set version.
For information about how to run the commands, see the Test Data Management 10.1.0 User Guide.
Pre Workflow and Post Workflow Plan Settings
In a TDM plan, you can select workflows that you want to run before and after the current workflow.
Configure the pre workflow parameter if you want to run a specific workflow before you run the workflow from the current plan. Configure the post workflow parameter if you want to run a specific workflow after you run the workflow from the current plan.
For information about how to configure and use pre workflow and post workflow parameters, see the Test Data Management 10.1.0 User Guide.