Class: SparkConf

eclairjs. SparkConf

Configuration for a Spark application. Used to set various Spark parameters as key-value pairs. Most of the time, you would create a SparkConf object with new SparkConf(), parameters you set directly on the SparkConf object take priority over system properties. All setter methods in this class support chaining. For example, you can write new SparkConf().setMaster("local").setAppName("My app"). Note that once a SparkConf object is passed to Spark, it is cloned and can no longer be modified by the user. Spark does not support modifying the configuration at runtime.

Constructor

new SparkConf()

Source:

Methods

set(key, value) → {module:eclairjs.SparkConf}

Wrapper of SparkConf.set method
Parameters:
Name Type Description
key string
value string
Source:
Returns:
Type
module:eclairjs.SparkConf

setAppName(appName) → {module:eclairjs.SparkConf}

Set a name for your application.
Parameters:
Name Type Description
appName string
Source:
Returns:
Type
module:eclairjs.SparkConf

setMaster(master) → {module:eclairjs.SparkConf}

The master URL to connect to, such as "local" to run locally with one thread, "local[4]" to run locally with 4 cores, or "spark://master:7077" to run on a Spark standalone cluster.
Parameters:
Name Type Description
master string
Source:
Returns:
Type
module:eclairjs.SparkConf