DSXchange

I also tried passing each file input through transformar adding the new column(hardcoded fileName), but linkCollector cannot be used to collect data from 4 Transformers stage because it give error that LinkCollector cannot collect data from active stages. You must not have read the Server Job Devel...

Agree. Take your lumps and do it right. Curious, how many is 'a lot'?

Talk to your admin, have them install the Sort stage. No need to 'get back to IBM' for that, someone just didn't bother to install it when they installed everything else. Probably several other optional plug-in stages you are 'missing' as well...

Of course it makes a difference and you must change the filename to a 'real' one from the default of the linkname. Otherwise, all you have is a relative filename rather than the absolute one you need and the file will end up in the job's Project directory named 'DSLink5'. And if it's a 'huge number ...

Stop including them as string literals.

No, they're not synonymous. EventType would have come from one of the 'Log' related functions. In the online help, use the Search tab and you'll see all of the functions that could have come from.

The InfoType is quite clearly noted in the online help, check the entry for DSGetLinkInfo.

(edited to correct EventType to InfoType)

Please re-post this in the correct forum, this is for Testimonials not problems with Parallel jobs.

You don't want to do that. Either abort the Server job and then use a Terminator stage to stop the Sequence, or build something to detect this 'condition' in your Server job (userstatus, perhaps? DSGetLinkInfo? depends on the nature of this condition) and do the same. Both downstream of the Job Acti...

Yes, thank you... unless you are willing to be patient and see if indeed the full table list can be imported if one just waits... and waits...

Another approch is create a singel job and running filename as parameter by some script which passes filename onebyone. I would suggest this approach and there's no reason it would be 'too complex in nature for maintain'. No script required but you could certainly take that approach. A Sequence job...

Good to know and perhaps one of these days there will be a place where tools like that can be uploaded and shared here. In the meantime, for completeness, can you do me a favor and expand a little bit on what exactly your issue was? You just mention the fact that you had one, but not what actually w...

abhilashnair wrote:I just came to know that the OS is limiting hash file size.

This would be your 'urgent' issue, I'd wager. Have your SA remove the file size limitation for your DataStage user.

Unfortunately, the issue will be the 'you will get a list of all the tables' part that has to happen before you can filter it down, I'd wager. Colin, are you having a problem fetching back that larger list? I don't think that widget can hold 70K entries and you can't filter out what isn't there in t...

You should preload and use a hashed file for the lookup - that's what they are there for, after all. Or solve your self-locking problem by setting your Transaction Size to 1.