Actian X 11.1 | Spark Provider Configuration

SQL Reference Guide > SQL Reference Guide > Using External Tables (X100 Only) > Spark Provider Configuration

Was this helpful?

Spark Provider Configuration

The configuration for the Spark Provider is read from $SPARK_HOME/conf/spark-defaults.conf. To override these settings for the provider, you can specify Spark configuration options in $II_SYSTEM/ingres/files/spark-provider/spark_provider.conf.

Note: For the configuration options in spark-defaults.conf to take effect permanently, they must be included in spark_provider.conf.

Any additional features that cannot be configured through the configuration file can be added directly to the spark-submit command that starts the Spark Provider in $II_SYSTEM/ingres/bin/spark_provider.

Last modified date: 11/09/2022