Prerequisites

The input stream must be sorted in a step prior to the Unique Rows step; otherwise, only consecutive double rows will be correctly analyzed and filtered.

The rows do not have to be pre-sorted if you use the Unique Rows (HashSet) step to run the transformation.