Appendix Default library and configuration paths for Spark execution engine 1
Applies to: Kyvos Enterprise Kyvos Cloud (SaaS on AWS) Kyvos AWS Marketplace
Kyvos Azure Marketplace Kyvos GCP Marketplace Kyvos Single Node Installation (Kyvos SNI)
The following table provides a list of the default Library and Configuration paths for the Spark execution engine.
Vendor | Spark Home Directory | Default Library Path | Default Configuration Path |
|---|---|---|---|
Cloudera | /opt/cloudera/parcels/CDH/lib/spark | /opt/cloudera/parcels/CDH/lib/ spark/lib/,/opt/cloudera/parcels/CDH/jars/spark-hive_x.x.x-cdhx.x.x.jar | /etc/spark/conf.cloudera.spark_on_yarn/ |
HDP 3.1.x Spark 2.3 | /usr/hdp/current/spark2-client | /usr/hdp/current/spark2-client/jars/,/usr/hdp/current/spark2-client/standalone-metastore/,/usr/hdp/current/hive_warehouse_connector/ | /etc/spark2/conf/ |
HDP 2.6.x Spark 2.1 | /usr/hdp/current/spark2- client | /usr/hdp/current/spark2- client/jars | /etc/spark2/conf |