Dynamically define the column names

Nagaraj · Post by **Nagaraj** » Wed Sep 23, 2009 9:00 am

Hi Folks,

In one column i have data like this,

hsd sdj hds ddh sdh hsd
hsd djd
ggh hsd jsd

i have to derive columns based on the delimeter, but the no of columns are dynamic, lets say we can find out the number of columns coming thru in each record. So is there any way of assigning each value to the subsequent columns defined in the transformer.

Thanks

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Wed Sep 23, 2009 9:26 am

Column Export ?

Nagaraj · Post by **Nagaraj** » Wed Sep 23, 2009 9:38 am

No

we are not sure how many columns we get...!

chulett · Post by **chulett** » Wed Sep 23, 2009 9:54 am

But do you know the maximum number you could get?

Nagaraj · Post by **Nagaraj** » Wed Sep 23, 2009 9:59 am

I assumed it cannot go more than 20 values like that and coded accordingly, its working but i wanted to code dynamically.

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Wed Sep 23, 2009 10:24 am

In that case, how do you intend to store in the target ?

Generally the target is a db and cannot have dynmically changing structure.

Maybe more information on your requirement will assist others in helping you.

srividya · Post by **srividya** » Wed Sep 23, 2009 12:23 pm

May be the data is record type driven, say the first 3 places are 001 then it is for one kind of data , if it is for 008 it is another set of data

Nagaraj · Post by **Nagaraj** » Wed Sep 23, 2009 12:45 pm

Yes Kind of Srividya,

I am defining n no of columns in transformer and after that i am funneling all the values so that it goes to one column, but in between i should apply different rules i wll have to treat my source column with many values as some array.

srividya · Post by **srividya** » Wed Sep 23, 2009 1:06 pm

will you be able to give a more specific screen shot of data than what you have already given? That would help us understand how the feed would look like

Sainath.Srinivasan · Post by **Sainath.Srinivasan** » Wed Sep 23, 2009 2:28 pm

So, do you want to normalise the structure ?

Nagaraj · Post by **Nagaraj** » Wed Sep 23, 2009 4:21 pm

i have two columns

A B

1 gfg gfg kzl dsk gdg
2 hdh hdh
3 dhd dhd hdh jdk jdj jdj kjd

column B values will be further derived and added in the end, doing group by column A.

Thanks

eostic · Post by **eostic** » Thu Sep 24, 2009 6:07 am

Looks like you are trying to do a classic pivot? do you want multiple rows --- one for each of the "B's" (each 3 character value to have its own row)?

Ernie

Nagaraj · Post by **Nagaraj** » Thu Sep 24, 2009 7:14 am

Please see the questiona again, i dont have problems with pivoting,
i want to calculcate how many values are there in an array and accordingly i have to put each of them in seperate columns(which has its own derivation), in the end i am funnelling.

kumar_s · Post by **kumar_s** » Thu Sep 24, 2009 7:16 am

How will you identify the individual column name for the column B.
Could you write up the expected output?

Nagaraj · Post by **Nagaraj** » Thu Sep 24, 2009 9:50 am

it has a delimeter, please see the first question asked initially.