Perform the following steps to specify the parameter in PDI using an environment variable.
From the Edit menu, select Set Environment Variables.
The Set Environment Variables table appears.
Enter the following information:
In the Name column, type spark.hadoop.validateOutputSpecs.
spark.hadoop.validateOutputSpecs
In the Value column, type false.
false
Click OK to activate the parameter.
You can verify it is active in the transformation logging.
For more information about processing Spark parameters, see the Administer Pentaho Data Integration and Analytics document.
Last updated 8 months ago
Was this helpful?