Remove duplicates from a Spark DataFrame
sdf_drop_duplicates
Description
Remove duplicates from a Spark DataFrame
Usage
sdf_drop_duplicates(x, cols = NULL)Arguments
| Arguments | Description |
|---|---|
| x | An object coercible to a Spark DataFrame |
| cols | Subset of Columns to consider, given as a character vector |