PreviousUsing the Apache Vanilla Hadoop driverNextConfigure CDP Public Cloud cluster with the PDI client
Last updated
Was this helpful?
Before you can add a named connection to a Hadoop cluster in Pentaho Data Integration (PDI), you must first install the vendor-specific Big Data plugin for your Hadoop cluster.
If you are connected to the Pentaho Repository and you plan to run Hadoop-related transformations on the Pentaho Server, install and configure the same driver on the Pentaho Server.
See the Manually install a driver for the Pentaho Server subsection of the Set up Pentaho to connect to a Hadoop cluster section.
Note: This task assumes that you downloaded the vendor-specific Big Data plugin from the Support Portal. The files are named pentaho-big-data-ee-plugin-<release-version>-<vendor>.zip.
The vendor-specific plugin files contain vendor abbreviations in the .zip file name:
Amazon EMR (emr)
Apache vanilla Hadoop (apachevanilla)
Azure HDInsight (hdi)
Cloudera Data Platform (cdp)
Google Dataproc (dataproc)
Perform the following steps to install the Big Data plugin in the PDI client:
Go to the data-integration/plugins folder in your PDI installation.
Extract the pentaho-big-data-ee-plugin-<release-version>-<vendor>.zip file into the plugins folder.
Restart PDI.
In the New cluster and Import cluster dialog boxes, the Current configured driver field shows the driver provided by the plugin you installed.
To create a named connection, see Adding a cluster connection.
For end-to-end connection setup context, see Connecting to a Hadoop cluster with the PDI client.
Last updated
Was this helpful?
Was this helpful?

