Databricks integration with INFACore using Databricks Connect
You can use INFACore in an integrated development environment that is compatible with Databricks such as JupyterLab, Visual Studio Code, or PyCharm.
Use the INFACore Python SDK code to leverage the INFACore functionality in your development environment, and then configure Databricks Connect from your environment to connect to a Databricks cluster and run the code remotely on that cluster. Databricks Connect is a client library for the Databricks runtime that runs jobs remotely on a Databricks cluster using Spark APIs.