org.apache.spark.sql.hive

Class RelationConversions

Object

org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>

org.apache.spark.sql.hive.RelationConversions

All Implemented Interfaces:

java.io.Serializable, Logging, scala.Equals, scala.Product

public class RelationConversions
extends org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>
implements scala.Product, scala.Serializable

Relation conversion from metastore relations to data source relations for better performance

- When writing to non-partitioned Hive-serde Parquet/Orc tables - When scanning Hive-serde Parquet/ORC tables

This rule must be run before all other DDL post-hoc resolution rules, i.e. PreprocessTableCreation, PreprocessTableInsertion, DataSourceAnalysis and HiveAnalysis.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
RelationConversions(org.apache.spark.sql.internal.SQLConf conf, org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog)

Method Summary

Modifier and Type	Method and Description
org.apache.spark.sql.catalyst.plans.logical.LogicalPlan	apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)
org.apache.spark.sql.internal.SQLConf	conf()
org.apache.spark.sql.hive.HiveSessionCatalog	sessionCatalog()
static String	toString()

Methods inherited from class org.apache.spark.sql.catalyst.rules.Rule

initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logDebug, logDebug, logError, logError, logInfo, logInfo, logName, logTrace, logTrace, logWarning, logWarning, org$apache$spark$internal$Logging$$log__$eq, org$apache$spark$internal$Logging$$log_, ruleName

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.internal.Logging

initializeLogging, log_

Constructor Detail

RelationConversions

public RelationConversions(org.apache.spark.sql.internal.SQLConf conf,
                           org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog)

Method Detail

toString

public static String toString()

conf

public org.apache.spark.sql.internal.SQLConf conf()

sessionCatalog

public org.apache.spark.sql.hive.HiveSessionCatalog sessionCatalog()

apply

public org.apache.spark.sql.catalyst.plans.logical.LogicalPlan apply(org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan)

Specified by:

apply in class org.apache.spark.sql.catalyst.rules.Rule<org.apache.spark.sql.catalyst.plans.logical.LogicalPlan>