Pipeline Designer

Pipeline Designer is a web-based interface that you can use to design, execute, and manage data integration workflows directly in your browser. A wide range of database connections, advanced transformation steps, and robust execution monitoring is supported in Pipeline Designer.

By default, Pipeline Designer is installed when you install the Pentaho Server. To update the Pipeline Designer plugin, use the Plugin Manager. For details, see Update plugins.

Note: The Project option appears on the main page of the Pipeline Designer but is not currently supported in Pipeline Designer. You can use Projects in the Pentaho Data Integration client. For details, see Organizing data integration with projects.

• Views in Pipeline Designer

  In Pipeline Designer, you can work with transformations and jobs in the Design View and review the raw XML in the XML View.

• Basic concepts of ETL in Pipeline Designer

  Pipeline Designer uses a workflow metaphor as building blocks for transforming your data and other tasks. Workflows are built using steps as you create transformations and jobs. Each step is joined by a hop which passes the flow of data from one item to the next.

• Manage transformations and jobs

  You can manage transformations and jobs on the Pipeline Designer's main page. Available actions include marking transformations and jobs as favorites, downloading them as files, creating duplicates, moving them to different folders or to the trash, renaming them, and viewing their details.

• Working with transformations

  Create, configure, and then run transformations to perform ETL tasks as part of specified workflow. After running a transformation, analyze its results to explore the data or to identify possible improvements or problems.

• Working with jobs

  Create, configure, and then run jobs to orchestrate ETL activities. After running a transformation, analyze its results to identify possible improvements or problems.

• Stop transformations and jobs

  There are two different methods you can use to stop a transformation or job running in the Pipeline Designer. The method you use depends on the processing requirements of your ETL task.

• Transformation steps in Pipeline Designer

  List of steps available for extending and expanding the functionality of transformations.

• Job steps in Pipeline Designer

  List of available steps for extending and expanding the functionality of jobs.