Using the Annotate Stream step

The Annotate Stream step helps you refine your data for the Streamlined Data Refinery by creating measures, link dimensions, or attributes on stream fields you specify.

If you want, you can create multiple annotations on the same field. For example, you might want to create an average measure and a sum measure on the same field. You can also annotate multiple streams to modify the same data model. Additionally, you can create and add calculated measures to the data model.

The Annotate Stream step modifies the default model produced from the Build Model job entry.

SDR workflow

After you are done annotating your data model, you are ready to publish it.

Metadata injection support

All fields of this step support metadata injection. You can use it with ETL metadata injection to pass metadata to your transformation at runtime.

When using metadata injection with the Annotate Stream step, you can reuse shared annotation groups that already exist, but you cannot create a new shared annotation group. If you inject a shared annotation group by providing a value for SHARED_ANNOTATION_GROUP, then the step assumes you are reusing an existing shared annotation group. As a result, any annotations defined in the ETL metadata injection step are ignored.