Spark Provider Configuration
The configuration for the Spark Provider is read from $SPARK_HOME/conf/spark-defaults.conf. To override these settings for the provider, you can specify Spark configuration options in $II_SYSTEM/ingres/files/spark-provider/spark_provider.conf.
Note: For the configuration options in spark-defaults.conf to take effect permanently, they must be included in spark_provider.conf.
Any additional features that cannot be configured through the configuration file can be added directly to the spark-submit command that starts the Spark Provider in $II_SYSTEM/ingres/bin/spark_provider.
Last modified date: 08/14/2024