Convert column(s) from avro format
R/sdf_interface.R
sdf_from_avro
Description
Convert column(s) from avro format
Usage
sdf_from_avro(x, cols)
Arguments
Arguments | Description |
---|---|
x | An object coercible to a Spark DataFrame |
cols | Named list of columns to transform from Avro format plus a valid Avro schema string for each column, where column names are keys and column schema strings are values (e.g., c(example_primitive_col = "string", example_complex_col = "{\"type\":\"record\",\"name\":\"person\",\"fields\":[ {\"name\":\"person_name\",\"type\":\"string\"}, {\"name\":\"person_id\",\"type\":\"long\"}]}") |