- You can now run metadata extraction jobs on pipelines containing the Delete activity type.
- You can now view the lineage of each iteration of the ForEach activity separately under the new ActivityInstance lineage hierarchy level. The ActivityInstance level is nested under the Activity level.
To prevent the old and new hierarchies from overlapping, run a catalog source job with the retention policy in the Metadata Change Option set to Delete. Objects that existed previously, but are not present in the new hierarchy, get deleted from the catalog along with their enrichments.
- You can evaluate Java BeanShell scripts to resolve text and process SQL scripts. If the evaluation breaks due to missing values, you can provide default values for the variables in the form of key-value pairs in the Default Variable Values property.
- You can extract metadata from scenario object types independent of the knowledge modules used to generate them.
You can now run incremental metadata extraction jobs on the following catalog sources:
•Microsoft Azure Data Lake Storage Gen2
•Microsoft SQL Server
A full metadata extraction extracts all objects from the source to the catalog. An incremental metadata extraction considers only the changed and new objects since the last successful catalog source job run. Incremental metadata extraction doesn’t remove deleted objects from the catalog and doesn’t extract metadata of code-based objects.
For more information about Microsoft Azure Data Lake Storage Gen2 and Microsoft SQL Server catalog sources, see Catalog Source Configuration.
View endpoint object recommendations for connection assignment
You can now view endpoint object recommendations when you assign reference catalog source connections to endpoint catalog source objects. The recommendations are a filtered list of endpoint objects based on connection characteristics. By default, the recommended endpoint objects appear in the Assign Connection dialog box. You can additionally view all the endpoint catalog source objects.
For more information about viewing endpoint object recommendations for connection assignment, see Assigning connections.