You can invoke the Databricks-TriggerPipeline process to trigger a pipeline using the Databricks API for the specified pipeline ID. This invocation returns a pipeline run ID, which you can then use to invoke the Databricks-MonitorPipelineStatus process to monitor the pipeline’s status.
Databricks-TriggerPipeline
1Open the Databricks-TriggerPipeline process and click Actions > Properties Details > Copy Service URL.
2Open a text editor and add the input fields and values to the service URL as shown in the following format:
<Cloud Application Integration POD URL>/active-bpel/public/rt/<API_name>?in_PipelineId=<Databricks pipeline ID>
3Open a browser and paste the service URL.
You will receive a pipeline run ID in the response.
Databricks-MonitorPipelineStatus
1Open the Databricks-MonitorPipelineStatus process and click Actions > Properties Details > Copy Service URL.
2Open a text editor and add the input fields and values to the service URL as shown in the following format:
<Cloud Application Integration POD URL>/active-bpel/public/rt/<API_name>?in_PipelineId=<Databricks pipeline ID>&in_Pipeline_Run_Id=<Run ID that you received after invoking the Databricks-TriggerPipeline process>
3Open a browser and paste the service URL.
You will receive a response that include details, such as pipeline ID, pipeline name, run ID, start time, and status.
You can also invoke these processes using the Run Using option, REST or SOAP API endpoints in API clients, such as cURL, Postman, SOAP UI, or through any programming language.