new PairDStream()
- Source:
Methods
reduceByKey(func) → {module:eclairjs/streaming/dstream.PairDStream}
Return a new DStream by applying `reduceByKey` to each RDD. The values for each key are
merged using the associative reduce function. Hash partitioning is used to generate the RDDs
with Spark's default number of partitions.
Parameters:
| Name | Type | Description |
|---|---|---|
func |
func |
- Source:
Returns:
reduceByKeyAndWindow(reduceFunc, windowDuration) → {module:eclairjs/streaming/dstream.PairDStream}
Create a new DStream by applying `reduceByKey` over a sliding window on `this` DStream.
Similar to `DStream.reduceByKey()`, but applies it over a sliding window. The new DStream
generates RDDs with the same interval as this DStream. Hash partitioning is used to generate
the RDDs with Spark's default number of partitions.
Parameters:
| Name | Type | Description |
|---|---|---|
reduceFunc |
func | associative reduce function |
windowDuration |
module:eclairjs/streaming.Duration | width of the window; must be a multiple of this DStream's batching interval |
- Source: