Open and rename the job

To copy files in these instructions, use either the Hadoop Copy Files job entry or Hadoop command line tools.

Perform the following steps to modify the sample Spark job and understand how a Spark Submit entry works in PDI:

1. Copy a text file that contains words that you would like to count to the HDFS on your cluster.

2. Start the PDI client.

3. Open the Spark Submit.kjb job, which can be found in the design-tools/data-integration/samples/jobs/Spark Submit folder.

4. Select File > Save As, and then rename and save the file as Spark Submit Sample.kjb.

The Spark Submit Sample.kjb file is saved to the jobs folder.

Spark Submit Sample Job