For the complete documentation index, see llms.txt. This page is also available as Markdown.

Multiple steps in a transformation cannot generate files to the same location

If your transformation contains multiple steps that generate output files to the same destination folder, the files might be missing or the data might be missing.

Spark requires unique names for the files and folders generated by each step. To resolve this issue, send the files from each step to unique folders with unique filenames.

Last updated

Was this helpful?