DSXchange

If the data is in a flat file and you are happy executing UNIX commands (e.g. ExecSh in a "before-job subroutine), you may want to consider the UNIX "uniq" command. There is an option that allows you to only output duplicated rows. Try "man uniq" at the UNIX command line for...

Hi sengs,

this is often referred to in these forums using the term "vertical pivot". Search the forum and see what you can find. Another search option to try is "man paste" (Craig - don't go there!).

David.

Hi Holymac, Let's see if the following helps you. 1) For each of the "code" blocks in the above thread, copy the text and paste it into a distinctly named file with a file name suffix of ".xml". 2) Run the DataStage Manager tool and select the menu option "Import/DataStage C...

Thanks for checking it out Jim. I only get to feed my UNIX addiction Monday through Friday!

David

Hence why, on reflection, I had offered the more robust alternative, ( sed 's/^\[[0-9]\{1,\},[0-9]\{1,\}\]//g' 's/\(|\)\[[0-9]\{1,\},[0-9]\{1,\}\]/\1/g' ), which deals with the coordinates at the start of the line explicitly and replaced "zero or more" instances of | with exactly one insta...

Yes. Though searching for coordinates prefixed by the | reduces the likelihood of an unexpected coordinate-like pattern embedded in the data, which is meant to be there, being discarded.

D

Ray, I guess you mean other than "man sed" and "man 5 regexp"? Basically the bit between the quotes is a command to sed (stream-editor). A breakdown of the particular command issued is as follows: s/\(|*\)\[[0-9][0-9]*,[0-9][0-9]*\]/\1/g s = substitute command / = delimiter for d...

Look at this thread?

man paste indeed!

David

and then there were 7

To add my standard reply ...

If the number of rows in the data set is consistent (e.g. there are always "n" rows in the data set that have to be vertically pivoted), I'd lay money on the unix "paste" command doing this quickest. Try "man paste" for more details.

David

On the presumption that the co-ordinates syntax does not appear within the useful data e.g. you don't have a field something like ...|[1,2]blah blah [3,5]blah|... see whether the following achieves the desired result. sed 's/\(|*\)\[[0-9][0-9]*,[0-9][0-9]*\]/\1/g' yourfile > newfile post the success...

Another alternative may be to do the splitting within UNIX. Run the command "man split" for more details. I would suggest it will be quicker using UNIX than using DS.

David

ray.wurlod wrote:I'm not doing DataStage at all this week - conducting a Red Brick training class

Ray, if the training is in Sydney and the participant is Phil from NZ, you can stun him by telling him that the devil duck is waiting for him on his desk on his return.

I'm interpreting your request as "how can you extract data from a system in one time zone and display the data meaningfully for another time zone" e.g. if the data has a timestamp of 15:00 in one time zone, for a time zone that is two hours in front of it, you want to diplay the time as 17...

As your are on unix, if the data is going to have a consistent number of rows each time (e.g. in your example always 3 rows to be turned into 3 columns), the unix "paste" command will achieve this. Try the commnad "man paste" for an explanation.

David.