Spark DataFrame from SQL

sdf_sql

Description

Defines a Spark DataFrame from a SQL query, useful to create Spark DataFrames without collecting the results immediately.

Usage

sdf_sql(sc, sql)

Arguments

Arguments Description
sc A spark_connection.
sql a ‘SQL’ query used to generate a Spark DataFrame.