Column Export for multiple column sets

[takyn]

Hi all,

I have a requirement to combine multiple columns into a single column. While this can be done in a Column Export stage, I need to do this for multiple sets of columns. I would ideally like to do this all in one stage rather than having to string together a number of Column Export stages.

i.e.
input columns:
ID_A, ID_B, ATT_X, ATT_Y, ATT_Z, TSP_1, TSP_2

output columns
ID, ATT, TSP

where:
ID is derived from ID_A, ID_B
ATT is derived from ATT_X, ATT_Y, ATT_Z
TSP is derived from TSP_1, TSP_2

I have to split these back out again into their respective columns afterwards as well (i.e. Column Import functionality).

Is there any way to do this? Some sort of custom stage perhaps? Or is it best to bite the bullet and just use multiple Column Export/Import stages as required.

Any advice would be greatly appreciated

-David

[ray.wurlod]

Transformer stages can perform both pieces of functionality. Depending on how they're combined (fixed width) you may be able to use a Modify stage to separate them later.