Set/Get Spark checkpoint directory

checkpoint_directory

Description

Set/Get Spark checkpoint directory

Usage

spark_set_checkpoint_dir(sc, dir)

spark_get_checkpoint_dir(sc)

Arguments

Arguments Description
sc A spark_connection.
dir checkpoint directory, must be HDFS path of running on cluster