Vector 6.3 | Set Up Spark-Vector Provider

User Guide > User Guide > B. Setting Up Spark for Use with Vector > Set Up Spark-Vector Provider

Was this helpful?

Set Up Spark-Vector Provider

To use Spark with Vector, you must download the Spark-Vector Connector. We recommend using the latest available Spark-Vector Provider for the Spark version you are using. See the Vector readme for the version of Spark required for the Provider.

The following steps assume that Vector and Spark are already installed.

To set up the Spark-Vector Provider

1. Download Spark-Vector Connector from http://esd.actian.com/product/drivers and extract the archive.

Note: The archive contains spark_vector_provider1.jar (for Spark 1) and spark_vector_provider2.jar (for Spark 2). Use the one that matches the Spark version you are using.

2. Copy the extracted driver to $II_SYSTEM/ingres/lib/spark_vector_providerX.jar, where X is either 1 or 2, depending on the Spark version used. Overwrite it, if necessary. (This step is not needed if the release contains a copy of the provider.)

Note: Verify that environment variables SPARK_MAJOR_VERSION and SPARK_HOME are set. SPARK_HOME must point to the local spark install directory and the SPARK_MAJOR_VERSION is 3.

3. Set spark_provider count in config.dat to 1.

Note: The iisuspark utility does this automatically.

iisetres "ii.$(iipmhost).ingstart.*.spark_provider" 1

4. Restart Vector to ensure the Spark-Vector Provider is started:

ingstop

ingstart

Last modified date: 12/06/2024