dstream

Type Members

1. class ConstantInputDStream[T] extends InputDStream[T]

   An input stream that always returns the same RDD on each timestep.

2. abstract class DStream[T] extends Serializable with Logging

   A Discretized Stream (DStream), the basic abstraction in Spark Streaming, is a continuous sequence of RDDs (of the same type) representing a continuous stream of data (see org.

3. abstract class InputDStream[T] extends DStream[T]

   This is the abstract base class for all input streams.

4. sealed abstract class MapWithStateDStream[KeyType, ValueType, StateType, MappedType] extends DStream[MappedType]

   :: Experimental :: DStream representing the stream of data generated by mapWithState operation on a pair DStream.

5. class PairDStreamFunctions[K, V] extends Serializable

   Extra functions available on DStream of (key, value) pairs through an implicit conversion.

6. abstract class ReceiverInputDStream[T] extends InputDStream[T]

   Abstract class for defining any org.apache.spark.streaming.dstream.InputDStream that has to start a receiver on worker nodes to receive external data.