transform a subset of column(s) in a Spark Dataframe
R/sdf_interface.R
transform_sdf
Description
transform a subset of column(s) in a Spark Dataframe
Usage
transform_sdf(x, cols, fn) Arguments
| Arguments | Description |
|---|---|
| x | An object coercible to a Spark DataFrame |
| cols | Subset of columns to apply transformation to |
| fn | Transformation function taking column name as the 1st parameter, the corresponding org.apache.spark.sql.Column object as the 2nd parameter, and returning a transformed org.apache.spark.sql.Column object |