Set Spark home variable
If you are using the Spark client from the Cloudera or Hortonworks Hadoop distributions, you may also receive the following log error:
Exception in thread "main" java.lang.NoSuchFieldError: TOKEN_KIND
If you received this log error, you must also complete the following steps for your Hadoop distribution:
Download the Spark client for your Hadoop cluster distribution (Cloudera or Hortonworks).
Navigate to the
adaptive-execution/config
directory and open theapplication.properties
file.Set the sparkHome location to where Spark 2 is located on your machine.
Example for Cloudera:
**sparkhome** = /opt/cloudera/parcels/SPARK2/lib/spark2
Example for Hortonworks:
**sparkhome** =/opt/horton/SPARK2/lib/spark2
Last updated
Was this helpful?