Package index
Deploys Databricks backed content to publishing server
install_pyspark() install_databricks()
Installs PySpark and Python dependencies
Lists installed Python libraries
Creates the ‘label’ and ‘features’ columns
Read Spark configuration
Writes the ‘requirements.txt’ file, containing the needed Python libraries
spark_connect_service_start() spark_connect_service_stop()
Starts and stops Spark Connect locally