DSXchange

It's the Aggregator. When I added a Sort stage before the Aggregator and asserted to it that the data was properly sorted, everything ran fine. Well, 'fine' in the fact that it didn't core dump... it took over 5 hours to process the 5.6 million records.

I'll double-check the kernel parameters.

As mentioned - format the output: IF(LNK1.TRANSACTIONTYPE = '100' ) Then '1215' : (LNK1.Year - 1) Else FMT(LNK1.PeriodNum:'15':LNK2.Year,"8'0'R") Note, the syntax is off the top of my head first thing in the morning, pre-coffee. It should be pretty darn close.

Checkpoints. 7.1 introduces the concept of 'Checkpoints' in Sequencer jobs. If you upgrade to 7.5 you'll find several new stages for Sequencer jobs that help out even more, but with checkpoints enabled in a Sequencer, it will automate the failure notification and restart. No need to build it all in...

Don't you just simply setup an @TRUE case at the end as a catch all? Whatever falls into it is the 'else' you are looking for, I believe.

Not in the budget, man. How about a solution that only requires blood, sweat, tears, sleepless nights or possibly more hair loss on my part?

Edit: Sorry, kind of skimmed over the UNIX sort bit. I could always try that, I suppose.

Actually, this looks like it might be volume related... I had forgotten that quite a bit of 'history' had been loaded over the weekend. Whereas before this job would aggregate a little over 1 million records without a problem, it now has more than that to group up for me. It gets to about 3.4 millio...

Simple as that? I'll let you know...

I did a quick check and couldn't find the information. I would guess that they equate to something like 'Stream', 'Reference' and possibly even 'Reject'... but I'll wait for one of the Grognards to show up and set us all straight.

Actually, it's an 8 immediately followed by a right paren.

It always turns it into the 'cooler' version unless you disable smileys.

Hmm... I see the difference - the build of the 'Engine' versus the 'Server'. The UNIX "dsebuildinfo.txt" file is pretty sparse, simply saying: 7.0.1.1r2 Mon Dec 8 11:04:10 2003 for my Engine on my system. Be nice if I could find the comprehensive build information like you posted...

I really don't think that's true. I have (according to the cdroms) 7.0.1 installed and the -info command shows 7.0.1.1r2 for the actual release. I've got 7.1 sitting in a drawer (never installed) and 7.5 off to my cyber center for installation on my test server. Help/About shows "Server version 7.0....

You should be able to simply do a 'Help / About' from any of the client tools nowdays, I would think. What does that show for you?

Out of curiousity - Has anyone read through this rather long thread on the subject by our beloved Mr Bland?

For starters, please read the documentation on the Row Splitter stage. You should be able to find a 'rowsplit.pdf' file in the Docs directory under your client installation. It does exactly what you are looking for, it sounds like.

Is this something that pops up if we don't use datastage for sometime? You'd have to tell us... does it? Do you have a connection timeout specified for the server? Timeout is enabled by default, so unless someone has changed it you do. Check in Administrator, if you do then you will get disconnecte...