# Select an Engine

You can select the **Pentaho Engine** to run transformations in the default Pentaho (Kettle) environment.

You can also use the **Spark Submit** job entry to run big data transformations on your Hadoop cluster to coordinate large amounts of data over multiple nodes. See [Spark Submit](/pdia-data-integration/9.3-data-integration/pdi-job-entries-reference-overview/spark-submit.md) for details.

## Pentaho Engine

The Pentaho engine does not execute sub-transformations or sub-jobs when you select the **Pentaho server** or **Slave server** option. If you want to run a sub-transformation on the same server where your parent job runs, select **Local** for the **Run Configuration** type.

![Run Configuration Dialog Box](/files/AlYkBfgHOCboGcDIowSd)

The **Settings** section of the Run configuration dialog box contains the following options when **Pentaho** is selected as the **Engine** for running a transformation:

| Option                           | Description                                                                                                                                                                                                                                                                                                                      |
| -------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Local**                        | Select this option to use the Pentaho engine to run a transformation on your local machine.                                                                                                                                                                                                                                      |
| **Pentaho server**               | Select this option to run your transformation on the Pentaho Server. This option only appears if you are connected to a [Pentaho Repository](/pdia-data-integration/9.3-data-integration/use-a-pentaho-repository-in-pdi.md).                                                                                                    |
| **Slave server**                 | Select this option to send your transformation to a slave (remote) server or Carte cluster.                                                                                                                                                                                                                                      |
| **Location**                     | <p>If you select <strong>Slave server</strong>, specify its location.</p><p>If you have set up a Carte cluster, you can specify <strong>Clustered</strong>. See <a href="/pages/m35R3ngRdqu42gZmDEjr">Use Carte Clusters</a> for more details.</p>                                                                               |
| **Send resources to the server** | If you specified a remote server for your remote **Location**, select to send your transformation to the specified server before running it. Select this option to run the transformation locally on the server. Any related resources, such as other referenced files, are also included in the information sent to the server. |
| **Log remote execution locally** | If you specified **Clustered** for your remote **Location**, select to show the logs from the cluster nodes.                                                                                                                                                                                                                     |
| **Show transformations**         | If you specified **Clustered** for your remote **Location**, select to show the other transformations that are generated when you run on a cluster.                                                                                                                                                                              |

## Spark Engine

![Run Configuration dialog box, Spark engine](/files/vrVa9DYTnmFNXjA9aAyC)

The **Settings** section of the Run configuration dialog box contains the following options when **Spark** is selected as the **Engine** for running a transformation:

| Option             | Description                                                                                         |
| ------------------ | --------------------------------------------------------------------------------------------------- |
| **Protocol**       | Select whether the protocol of the **Spark host URL** uses standard HTTP or HTTPS (SSL encryption). |
| **Spark host URL** | Specify the address and port for the AEL daemon.                                                    |

Ask your Pentaho or IT administrator as to which **Protocol** to use and the value for **Spark host URL**. You can use Kettle [parameters](https://github.com/pentaho/documentation/blob/main/PDIA/9.3/PDI/Data%20Integration%20Perspective/Data%20Integration%20perspective%20in%20the%20PDI%20client/Advanced%20topics%20\(PDI%20perspective\)/PDI%20run%20modifiers=GUID-8D2A6093-A284-4BD3-9722-E14328F965AE=4=en=.md), [variables](https://github.com/pentaho/documentation/blob/main/PDIA/9.3/PDI/Data%20Integration%20Perspective/Data%20Integration%20perspective%20in%20the%20PDI%20client/Advanced%20topics%20\(PDI%20perspective\)/PDI%20run%20modifiers/Variables=GUID-1DAC4903-314F-4AE3-9B34-5B6FD34AF637=4=en=.md), and [Kettle variables](/pdia-data-integration/9.3-data-integration/data-integration-perspective-in-the-pdi-client/advanced-topics-pdi-perspective/pdi-run-modifiers/variables/kettle-variables.md) for these options to create a run configuration that works across multiple environments. Your administrator must set up the Adaptive Execution Layer (AEL before you can use the Spark engine.

See the **Administer Pentaho Data Integration and Analytics** document if issues occur while trying to use the Spark engine.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.pentaho.com/pdia-data-integration/9.3-data-integration/data-integration-perspective-in-the-pdi-client/work-with-transformations-cp/run-your-transformation/run-configurations-work-with-transformations/select-an-engine.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
