org.apache.spark.sql.sources

Interface StreamSourceProvider

public interface StreamSourceProvider

::Experimental:: Implemented by objects that can produce a streaming Source for a specific format or system.

Since:

2.0.0

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.spark.sql.execution.streaming.Source	createSource(SQLContext sqlContext, String metadataPath, scala.Option<StructType> schema, String providerName, scala.collection.immutable.Map<String,String> parameters)
scala.Tuple2<String,StructType>	sourceSchema(SQLContext sqlContext, scala.Option<StructType> schema, String providerName, scala.collection.immutable.Map<String,String> parameters) Returns the name and schema of the source that can be used to continually read data.

Method Detail

sourceSchema

scala.Tuple2<String,StructType> sourceSchema(SQLContext sqlContext,
                                           scala.Option<StructType> schema,
                                           String providerName,
                                           scala.collection.immutable.Map<String,String> parameters)

Returns the name and schema of the source that can be used to continually read data.

Parameters:

sqlContext - (undocumented)

schema - (undocumented)

providerName - (undocumented)

parameters - (undocumented)

Returns:

(undocumented)

Since:

2.0.0

createSource

org.apache.spark.sql.execution.streaming.Source createSource(SQLContext sqlContext,
                                                           String metadataPath,
                                                           scala.Option<StructType> schema,
                                                           String providerName,
                                                           scala.collection.immutable.Map<String,String> parameters)

Parameters:

sqlContext - (undocumented)

metadataPath - (undocumented)

schema - (undocumented)

providerName - (undocumented)

parameters - (undocumented)

Returns:

(undocumented)

Since:

2.0.0