DSXchange

True... from what I recall there is an option in the Folder stage to return either the full pathname or just the filename. Can't check right now.

Yah, good luck with that. Got stuck in an endless 'self nomination loop' once, boy was that frustrating. Not even the 'admin approval' part worked until we got IBM on the phone and all three of us walked through it simultaneously with the IBM guy disappearing behind the curtain from time to time to ...

So... maybe it's just me but I'm not really sure what exactly you want out of this. Are you literally trying to find and extract (as one example) this complete string? EMP_FIRSTNAME=LATHEEF SYED and that's it, we're done? Or do you have an EMP_FIRSTNAME field you are trying to populate, so first you...

Use the Field() function downstream of the Folder stage in a transformer. Think of your filename field as an "underscore delimited string" and then ask Field() to get you the 3rd field from the string. Then either substring off everything in the result before the dot or just the first thre...

What am I missing here? How is the answer not the $Counter variable?

ps. The Folder stage does not 'concatenate all files to a single file'. It does, however, get you the entire file contents in a single row. One row per file, in essence, hence the need for the Row Splitter.

They don't want to install one what? AutoSys client on the DataStage server? Is it a licensing issue? :? You can look into installing a DS client on the AutoSys server, provided it's a Windows box, and then use dsjob from there to run jobs, I do believe. Never tried it. Best answer would be to have ...

I'm not sure what you are asking. Your "AutoSys administrator" should be able to answer questions like this, though, I would hope.

If it works like the other Enterprise Schedulers I've seen, you would need to install the AutoSys client on every box where it would be controlling processes.

Right... and how many characters from the string are you substringing out for the date piece?

Apparently they did but couldn't be bothered to post it. [sigh]

The Transformer is an active stage so it typically is the one to report 'abnormal termination' messages. And the Merge stage uses hashed files under the covers to do the dirty deed and is known to fall over dead with large files to merge. Did you get anything 'From previous run...' when you Reset th...

Please post the actual resolution to your problem, simply marking it as resolved helps no-one else.

Or perhaps check if the file is empty before the job starts and conditionally append this 'hardcoded record' to it.

Ah, even better advice. My DOS days are way too far behind me, it seems.