Data Engineering
Read this section to learn what's new for Data Engineering in version 10.5.3.
Databricks Job Cluster Support
Effective in version 10.5.3, you can configure the Create Cluster task to create a Databricks job cluster. You can use job clusters to run fast and robust automated jobs in the Databricks environment. When you configure a cluster task to create a job cluster, Databricks deletes the cluster when the job is complete, so you don't need to create a Delete Cluster task.
For more information, see the Developer Workflow Guide.