Like what you see? Have a play with our trial version.

This section deals with the interesting bits involved in fully implementing a step. A step that implements the ETLStep interface will be recognised as a Data Transformation step. However, Yellowfin has partially implemented the interface and provides a few abstract classes to make implementation easier. We recommend extending these abstract classes:


ClassPurpose
AbstractETLRowStepExtend this class if the step is required to process data row by row and output data as and when it is processed. Filter and Calculated Field are examples of row steps.
AbstractETLCachedStepThis class should be extended if the step is required to accumulate data before it can begin processing. For example, Merge and Union are cached steps.
AbstractETLInlineRowStepInline transforms are expected to be row steps. Extend AbstractETLInlineRowStep to implement an inline transform.




Types of Step Implementation

Depending on which abstract class is used different methods need to be implemented. There are some common aspects though. For ease of understanding, the implementation details are split into three sections:



  • No labels