[Python] How do I resolve a CONFIG_NOT_AVAILABLE error in Databricks

I am a Databricks newbie attempting to reproduce the actions in a training video. I have successfully uploaded a *.csv file, surgeries2.csv, using spark.read.csv, which displays properly.

My next step is to use Feature Engineering to create a table. On my way to that step, I am attempting to initialize a Feature Engineering Client, but I receive an error:

from databricks.feature_engineering import FeatureEngineeringClient
from pyspark.sql import SparkSession

# Initialize Spark session
spark = SparkSession.builder \
.config("spark.databricks.mlflow.modelRegistryUri", "databricks://Volumes/surgery_cat/default/surgery_volume") \
.getOrCreate()

# Initialize FeatureEngineeringClient
fe = FeatureEngineeringClient()


The line assigning fe causes an error:

[CONFIG_NOT_AVAILABLE] Configuration spark.mlflow.modelRegistryUri is not available. SQLSTATE: 42K0I
File <command-2122396893993854>, line 10


I have used the Databricks "Diagnose error" button and the "Fix my code" button, but I continue to receive the reported error. Any assistance is appreciated.

Continue reading...