Set/Get Spark checkpoint directory
R/spark_utils.R
checkpoint_directory
Description
Set/Get Spark checkpoint directory
Usage
spark_set_checkpoint_dir(sc, dir)
spark_get_checkpoint_dir(sc) Arguments
| Arguments | Description |
|---|---|
| sc | A spark_connection. |
| dir | checkpoint directory, must be HDFS path of running on cluster |