Install and configure Spark client for PDI use

You will need to install and configure the Spark client on every machine where you want to run Spark jobs using PDI. The configuration of the client depends on your version of Spark. Pentaho supports Cloudera Distribution of Spark (CDS) versions 2.3.x and 2.4.x.

CAUTION:

Pentaho does not support version 2.4.2 because it does not support Scala version 2.11.