Multiple steps in a transformation cannot generate files to the same location
If your transformation contains multiple steps that generate output files to the same destination folder, the files might be missing or the data might be missing.
Spark requires unique names for the files and folders generated by each step. To resolve this issue, send the files from each step to unique folders with unique filenames.
Last updated
Was this helpful?