> For the complete documentation index, see [llms.txt](https://docs.pentaho.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.pentaho.com/pdc-10.2-data-optimizer/pdso-install-landing-page/pdso-install-in-hadoop-cluster/pdso-configure-data-storage-optimizer/pdso-configuration-parameters/pdso-configuration-ambari.md).

# General Data Optimizer Configuration for Ambari

{% hint style="warning" %}
Never modify the **BUCKET** and **MOUNT\_POINT** parameters in the Data Optimizer configuration file after the initial installation. Changing these values after installation breaks the instance because the Data Optimizer instance ID is calculated based on the values provided in these parameters.
{% endhint %}

{% hint style="info" %}
Do not include leading or trailing spaces if you copy and paste parameter values. Ambari and Cloudera Manager do not validate input.
{% endhint %}

| Parameter                      | Description                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| ------------------------------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------ | -------------------------------------------------------------------- | ---- | ----------------------------------------- | ------------------------------------------------------- | ---- | -------------- | ---------------- | ---- | -------------------------------------------------------------- | ----------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **ENDPOINT\_TYPE**             | <p>The type of S3 endpoint you are using. Acceptable, case sensitive values are <em>HCP</em>, <em>HCPCS</em>, and <em>AWS</em>. The default value is HCP. - If connecting to Hitachi Content Platform, use <em>HCP</em>.</p><ul><li>If connecting to Virtual Storage Platform One Object, use <em>HCPCS</em>.</li><li>If connecting to Amazon S3, use <em>AWS</em>.</li></ul>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **AWS\_REGION**                | The AWS region that Ambari connects to. The AWS\_REGION value is required if *S3 Endpoint Type* is *AWS*.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **ENDPOINT**                   | <p>The S3 endpoint URL for the object storage service.- If the <strong>ENDPOINT\_TYPE</strong> is <em>HCP</em>, use the form <code>tenant.hcp\_dns\_name</code>.</p><ul><li>If the <strong>ENDPOINT\_TYPE</strong> is <em>HCPCS</em>, use the form <code>hcpcs\_dns\_name</code>.</li><li>If the <strong>ENDPOINT\_TYPE</strong> is <em>AWS</em>, you can leave the field blank or populate it with a region-specific S3 endpoint.</li></ul>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **BUCKET**                     | S3 bucket used on the object store for all the backend storage of the Data Optimizer instances.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                              |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **ACCESS\_KEY**                | S3 Access Key ID used to authenticate S3 requests to the object store.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **SECRET\_KEY**                | S3 Secret Key used to authenticate S3 requests to the object store.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **ENDPOINT\_SCHEME**           | S3 Connection Scheme or Endpoint Scheme. Acceptable, case sensitive values are *https* and *http*. The default value is https. If set to *https*, Data Optimizer uses TLS to encrypt all communication with object storage.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **VERIFY\_SSL\_CERTIFICATE**   | <p>Value used to specify whether to verify certificates within the Data Optimizer volume. Acceptable, case sensitive values are <em>Enabled</em> and <em>Disabled</em>. The default value is Enabled.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        | If the <strong>ENDPOINT\_SCHEME</strong> parameter is: | Then set the <strong>VERIFY\_SSL\_CERTIFICATE</strong> parameter to: | <br> | ----------------------------------------- | ------------------------------------------------------- | <br> | <em>https</em> | <em>Enabled</em> | <br> | <em>https</em> and the object store certificate is self-signed | <em>Disabled</em> | </p><p>By default, Content Platform uses a self-signed certificate that is not in the trust store on the HDFS DataNode. Disabling verification allows TLS negotiation to occur, despite the untrusted certificate. Disabling verification does not reduce the strength of TLS encryption, but it does disable endpoint authentication. It is a best practice to replace the Content Platform self-signed certificate with one signed by a trusted certificate authority. See the <strong>Hitachi Content Platform</strong> documentation for details.</p> |
| **MOUNT\_POINT**               | HDFS DataNode local directory where the Data Optimizer instance is mounted. HDFS writes block replicas to the local directory you specify. The **MOUNT\_POINT** parameter value must be a fully-qualified directory path starting at the system root (`/`).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **VOLUME\_STORAGE\_LIMIT\_GB** | The storage capacity in GB of each Data Optimizer volume instance. If the combined usage of Data Optimizer volumes exceeds the quota allocated to their shared bucket on Content Platform, writes to those Data Optimizer volumes fail. The **VOLUME\_STORAGE\_LIMIT\_GB** parameter value, multiplied by the number of Data Optimizer instances should not exceed the Content Platform quota. In fact, the Content Platform quota should include additional capacity for deleted versions and to account for asynchronous garbage collection services. HDFS writes only the amount of data to each Data Optimizer volume that is equal to or less than the amount specified in the **HCP Bucket Storage Limit** parameter, minus the reserved space (`dfs.datanode.du.reserved`).                                                                                                                                                                                           |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **CACHE\_DIR**                 | A local directory on the HDFS DataNode that Data Optimizer uses to store temporary files associated with open file handles. The **CACHE DIR** parameter must be a fully-qualified directory path starting at the system root (`/`).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **MD\_STORE\_DIR**             | Local directory on each node used to store files associated with persisting the Data Optimizer local metadata store. The **MD\_STORE\_DIR** parameter value must be a fully-qualified directory path starting at the system root (`/`). Specify a value for **MD\_STORE\_DIR** when the **CACHE\_DIR** directory is located is on volatile storage or if there is a more durable location for long term file persistence. Do not choose a volatile storage medium for this directory as it is intended to persist for the life of the Data Optimizer volume. If the files associated with metadata store persistence are lost or corrupted, you can recover them as explained in [Recovering from local metadata store failure or corruption](/pdc-10.2-data-optimizer/pdso-install-landing-page/pdso-install-in-hadoop-cluster/pdso-maintain-landing-page/pdso-maintain-data-optimizer-metadata-cp/pdso-recovering-from-loss-or-corruption-of-the-local-metadata-store.md). |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **LOG\_LEVEL**                 | Value used to specify how verbose the logging is for Data Optimizer. The default value is WARNING. Acceptable, case sensitive values are *ALERT*, *ERR*, *WARNING*, *INFO*, and *DEBUG*. See [Data Optimizer logging](/pdc-10.2-data-optimizer/pdso-install-landing-page/pdso-install-in-hadoop-cluster/pdso-maintain-landing-page/troubleshoot-data-storage-optimizer-fs/data-storage-optimizer-logging.md) for details about logging and log levels.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |
| **LOG\_SDK**                   | Optional. Local directory where detailed AWS S3 logs are saved. If the **LOG\_SDK** parameter is specified and if **LOG\_LEVEL** is set to *DEBUG*, Data Optimizer volumes log details about the S3 communication between the Data Optimizer volume instance and Content Platform. The `LOG_SDK` parameter value must exist, must be a fully-qualified directory path starting at the system root (`/`), and the HDFS user using Data Optimizer must have write permission for the directory. See [AWS S3 SDK logging](/pdc-10.2-data-optimizer/pdso-install-landing-page/pdso-install-in-hadoop-cluster/pdso-maintain-landing-page/troubleshoot-data-storage-optimizer-fs/data-storage-optimizer-logging/pdso-aws-s3-sdk-logging.md) for further details.                                                                                                                                                                                                                   |                                                        |                                                                      |      |                                           |                                                         |      |                |                  |      |                                                                |                   |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           |

{% hint style="info" %}
The configuration file is located in the \`/etc/ldo\` directory on each HDFS DataNode on which both the Data Optimizer is installed, and the \*\*ARCHIVE\*\* volumes are configured.
{% endhint %}


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.pentaho.com/pdc-10.2-data-optimizer/pdso-install-landing-page/pdso-install-in-hadoop-cluster/pdso-configure-data-storage-optimizer/pdso-configuration-parameters/pdso-configuration-ambari.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.