Specify the parameter as an environment variable in PDI
Perform the following steps to specify the parameter in PDI using an environment variable.
From the Edit menu, select Set Environment Variables.
The Set Environment Variables table appears.
Enter the following information:
In the Name column, type
spark.hadoop.validateOutputSpecs
.In the Value column, type
false
.
Click OK to activate the parameter.
You can verify it is active in the transformation logging.
For more information about processing Spark parameters, see the Administer Pentaho Data Integration and Analytics document.
Last updated
Was this helpful?