Set up the application properties file
You must set up the application.properties
file to permit Spark jobs on AEL to access the hbase-site.xml
file from the HDFS cluster. This setup enables Spark jobs to connect to HBase from the Spark Executors. You must also specify the location of the vendor-specific JARs described below so they can be loaded on the classpath.
Perform the following steps to set up the application.properties
file:
Navigate to the
design-tools/data-integration/adaptive-execution/config
folder and open theapplication.properties
file with any text editor.Set the value of thehbaseConfDir property to the location of your
hbase-site.xml
file.Set the value of the extraLib property to the location of the vendor-specific JARs.
The default value is ./extra.
Save and close the file.
Last updated
Was this helpful?