Data Quality can paginate up to 500,000 rows of dictionary data at a time, based on five columns of dictionary data. The physical limit for your dictionary depends on the number of rows and columns in the dictionary and the number of characters in each cell. The limit governs any operation to view or update data, such as a search and replace operation, that you perform in the dictionary.
When a dictionary contains more data than Data Quality can paginate in a single operation, you can use the filter query options to retrieve a subset of the dictionary data. Data Quality applies the filter to the complete dictionary, regardless of the quantity of data that the dictionary may contain. Use the Add Filter option to define the filter query.
A single filter query can return data up to the pagination limit. You can define multiple filters if necessary to cover the complete contents of your dictionary.
Note: The complete dictionary data set is available to assets that you test in Data Quality and to transformations that contain Data Quality assets.
The following image shows the options that you use to create a filter query:
The dialog box contains the following options and attributes:
1Query scope option.
Determines whether the dictionary data that the query retrieves must meet any condition that you add or all conditions that you add.
2Operator attribute.
Indicates the operator for each condition. The operator determines how the query analyzes the column data. You can select the following operations:
- Equals
- Not Equals
- Contains
- Not Contains
- Has Data
- Has No Data
3Values attribute.
Specifies the value that the condition looks for in a column when you select one of the following operators: Equals, Not Equals, Contains, or Not Contains.
4Add option.
Adds a condition to the query. You can add one or more conditions.
5Columns attribute.
Indicates the column to which each condition applies.
Running a query on a large dictionary
You can create a filter query to retrieve data from the full set of dictionary values. The filter options are available in very large dictionaries.
You build a filter query on dictionary column values. For example, you can create a query that can retrieve rows with given values in a column that you select.
1On the Configuration view, click Add Filter.
2In the Add Filter dialog box, click the '+' symbol to add a condition.
3Choose a column and an operator for the condition. If required, add a value that the query can look for in the column.
4Add more conditions if required.
5If you add multiple conditions, choose one of the following options:
- All. Data Quality retrieves any row that meets all of the conditions.
- Any. Data Quality retrieves any row that meets at least one of the conditions.
6Click Apply.
Note: To edit a query, click Edit Filter in the Configuration pane.
