Class: SQLContext

eclairjs/sql.SQLContext

The entry point for working with structured data (rows and columns) in Spark. Allows the creation of DataFrame objects as well as the execution of SQL queries.

Constructor

new SQLContext(SparkContext)

Parameters:
Name Type Description
SparkContext module:eclairjs.SparkContext
Since:
  • EclairJS 0.1 Spark 1.0.0
Source:

Methods

createDataFrame(rowRDD, schema) → {module:eclairjs/sql.DataFrame}

Creates a DataFrame from RDD of Rows using the schema
Parameters:
Name Type Description
rowRDD Array.<module:eclairjs/rdd.RDD> -
schema module:eclairjs/sql/types.StructType -
Source:
Returns:
Type
module:eclairjs/sql.DataFrame

createDataFrameFromJson(schema) → {module:eclairjs/sql.DataFrame}

Creates a DataFrame from RDD of JSON
Parameters:
Name Type Description
{{module:eclairjs.RDD} RDD of JSON
schema object object with keys corresponding to JSON field names (or getter functions), and values indicating Datatype
Source:
Returns:
Type
module:eclairjs/sql.DataFrame
Example
var df = sqlContext.createDataFrame([{id:1,"name":"jim"},{id:2,"name":"tom"}], {"id":"Integer","name","String"});

read() → {module:eclairjs/sql.DataFrameReader}

Returns DataFrameReader
Source:
Returns:
Type
module:eclairjs/sql.DataFrameReader

sql(sqlString) → {module:eclairjs/sql.DataFrame}

Returns DataFrame
Parameters:
Name Type Description
sqlString string
Source:
Returns:
Type
module:eclairjs/sql.DataFrame

table(tableName) → {module:eclairjs/sql.DataFrame}

Returns the specified table as a DataFrame.
Parameters:
Name Type Description
tableName string
Source:
Returns:
Type
module:eclairjs/sql.DataFrame