DSXchange

Google the term, plenty of sources out there that explain what it is and how it works.

Should also note that with this technique, sorting isn't necessary as input order doesn't matter.

Meaning, the same hashed file as both a lookup and your target. Hashed | Source -> Trn -> Hashed -> [calc days] Don't cache the lookup so the writes are immediately available. Every input record gets written to the hashed file. On a 'miss' you assemble a new record with all except one data field emp...

Max? No way to really answer that except to say "more". Let "them" know how important this is and insist they add more space.

So... not strictly chronological as I assumed where all you need is the number of days between any two status changes. Rather, for each Id you need a series of day counts between specific status changes? And when you said: "I need to calculate days for status change from 5 to 28, 5 to 27, 5 to 26, ...

Why not get more space by physically adding more? Filling that space is a Bad Thing and will wreak all kinds of havoc on your projects when it happens. Get more disk. No, it is not advisable you remove any files of that nature. For the LOG files, however, it is highly advisable that you manage their...

That 'time' was over a year ago. By now they've either solved their little problem or don't really care any more.

Ken Bland has a utility that will easily handle #1 and is part of what he gives away for free from his website.

Control jobs.

I'm not really sure what other kind of answer you would be looking for, but as always a more specific question will get you a more specific answer.

Sorting is sorting, so there's nothing all that mysterious going on except for two things: 1) Always provide a 'real' temporary file location in the stage, like "/tmp" for it to use. By default it will use the job's Project directory and you don't want to do that. 2) The 'Sort Specifications' can be...

Better ideas than what? What have you tried so far?

You can't "sort" in a Transformer. You can, hower, use the oddly named Sort stage in a Server job.

No clue, never heard of it. Hmm...

http://www.flightlab.com/~joe/hxml/

Joe English wrote:HXML is a non-validating XML parser written in Haskell. It is designed for space-efficiency, taking advantage of lazy evaluation to reduce memory requirements. HXML may be used as a drop-in replacement for the HaXml parser in existing programs.

No, you mean CLEAR.FILE rather than delete.

Clearing the directory is fine as long as you know no jobs are running at the time. None. Otherwise delete from the O/S any files that are over a certain amount of time old, say a day or two. Do that daily.

Welcome. :D

Googled this up in a couple of seconds:

http://www.thescripts.com/forum/thread638670.html

There were quite a number of other hits for your error message.