> For the complete documentation index, see [llms.txt](https://docs.pentaho.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.pentaho.com/pdia-data-integration/pdi-transformation-steps-reference-overview/kinesis-producer.md).

# Kinesis Producer

The Kinesis Producer step pushes data from a PDI transformation to an existing stream in a specific region within the Amazon Kinesis Data Streams (KDS) service. You can use this step to publish a [stream of data](https://docs.pentaho.com/pdia-data-integration/extracting-data-into-pdi/streaming-analytics.md) to KDS for storage in S3, Redshift, or EMR HDFS. For more information about the Amazon Kinesis Data Streams protocol, see <https://aws.amazon.com/kinesis/>.

For the Kinesis Producer step, configure the connection to Amazon and specify the target Amazon region and KDS stream. Only one region can be selected.

### Step name

* **Step name**: Specifies the unique name of the Kinesis Producer step on the canvas. Default: `Kinesis Producer`.

### Options

The Kinesis Producer step includes the following tabs.

* **Setup**
* **Options**

#### Setup tab

In this tab, define the connection to the Amazon region, the target stream in the Amazon Kinesis Data Streams (KDS) service, the partition key field, and the message field.

![Kinesis Producer setup tab](https://773338310-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYwnJ6Fexn4LZwKRHghPK%2Fuploads%2Fgit-blob-76a5e4d61078dbdd68f670c1c8039643952d3033%2FPDI_TransStep_Dialog_Kinesis_Producer_width_616.png?alt=media)

| Option                  | Description                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| ----------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Region**              | Specify the Amazon geographical region where the stream is located. You can select only one region.                                                                                                                                                                                                                                                                                                                                                                   |
| **Stream name**         | <p>Specify the Amazon KDS stream name by using one of the following methods:</p><ul><li><strong>Specify stream name</strong></li></ul><p>Specify the <strong>Stream name</strong> to which the data will be published.</p><ul><li><strong>Get data from field</strong></li></ul><p>Specify the <strong>Field name</strong> from another step that is generating data in the transformation stream. Using the drop-down list, select the name of the field to use.</p> |
| **Partition key field** | Select the PDI field that contains the partition key. The partition key is used to group records into shards within the stream.                                                                                                                                                                                                                                                                                                                                       |
| **Message field**       | Select the PDI field that contains data to write to the stream.                                                                                                                                                                                                                                                                                                                                                                                                       |

#### Options tab

In this tab, define the **Value** for the following write and connection timeout settings.

![Kinesis Producer options tab](https://773338310-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYwnJ6Fexn4LZwKRHghPK%2Fuploads%2Fgit-blob-c945483b77d1d822f0bce905e3c09f6187bbd524%2FPDI_TransStep_Tab_Options_Kinesis_Producer_width_608.png?alt=media)

| Name                                       | Value                                                                                                                                                   |
| ------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Write Timeout Seconds**                  | Specify a timeout value (in seconds) for the Kinesis Producer step to wait for the next time to write to the KDS stream. Default: `30`.                 |
| **Connection Timeout Seconds**             | Specify a timeout value (in seconds) for the Kinesis Producer step to wait while trying to connect to the server. Default: `2`.                         |
| **Connection Acquisition Timeout Seconds** | Specify a timeout value (in seconds) for the Kinesis Producer step to wait while trying to connect after the initial connection is made. Default: `10`. |

### Metadata injection support

This step supports metadata injection. You can use it with [ETL metadata injection](https://docs.pentaho.com/pdia-data-integration/pdi-transformation-steps-reference-overview/etl-metadata-injection.md) to pass metadata to your transformation at runtime.

### See also

* [Kinesis consumer](https://docs.pentaho.com/pdia-data-integration/pdi-transformation-steps-reference-overview/kinesis-consumer.md)


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://docs.pentaho.com/pdia-data-integration/pdi-transformation-steps-reference-overview/kinesis-producer.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
