Fields
The Fields section contains the following items:

The Pass through fields from the previous step option reads the fields from the input file without redefining any of the fields.
The table defines the data about the columns to read from the Parquet file.
The table in the Fields section defines the fields to read as input from the Parquet file, the associated PDI field name, and the data type of the field.
Enter the information for the Parquet input step fields, as shown in the following table:
Path
Specify the name of the field as it will appear in the Parquet data file or files, and the Parquet data type.
Name
Specify the name of the input field.
Type
Specify the type of the input field.
Format
Specify the date format when the Type specified is Date.
Provide a path to a Parquet data file and click Get Fields. When the fields are retrieved, the Parquet type is converted to an appropriate PDI type, as shown in the table below. You can preview the data in the Parquet file by clicking Preview. You can change the Type by using the Type drop-down or by entering the type manually.
Last updated
Was this helpful?