Main options tab

Option

Description

Partition data over tables

Select to split the data over multiple tables based on the value of the date field specified in the Partitioning field. When this option is selected, data is inserted into tables whose names follow the pattern <target-table>_<date-format>. These tables must be created manually before running the transformation in order for data to be inserted in these tables. See Partition data per month/Partition data per day for details on the date format.

Partitioning field

Specify the date field you want to use to determine how to split values across multiple tables. This value is used to generate a dated table name into which data will be inserted.

Partition data per month/ Partition data per day

Determines the date format used in the table name when partitioning the table: yyyyMM for Partition data per month and yyyyMMdd for Partition data per day.

Use batch update for inserts

Select to use batch inserts. This option groups INSERT statements, which limits round trips to the database. This option is enabled by default. The batch mode is only used when the following conditions are met:

  • The Use batch update for inserts check box is selected.

  • The Commit Size option is greater than 0.

  • The Return auto-generated key option is cleared.

  • The transformation is not enabled to use unique connections (Transformation properties > Misc Tab > Make the transformation database transactional).

  • The database type supports batch updates.

There are limiting factors depending on the database type and further step options.

Is the name of the table defined in a field?

Select to specify the name of the target table in the Field that contains name of table. This option allows you to store data from each row in a different table, based on the value of the Field that contains name of table. For example, if you store customer data in a field named gender, the data might end up in tables Male and Female.

Field that contains name of table

Specify the field name to use for the name of the table when the option Is the name of the table defined in a field? is selected.

Store the table name field

Select to store the table name in the output. When using this option, the table must contain a column with the name you defined in the Field that contains name of table.

Return auto-generated key

Select to return the key that was generated by inserting a row into the table.

Name of auto-generated key field

Specify the name of the new field in the output rows that contains the auto-generated key.

Last updated

Was this helpful?