DSXchange

This is a very popular topic lately. I'm still somewhat at a loss as to why people would want to capture and save all of this information. Metrics, yes, but entire job logs? Ok, if that's what you need to do... Basically, you need to tell it when to start as by default it will give you everything in...

I was revisiting a presentation I sat in on during Ascentialworld this year, one by BCBS on how they've implemented distributed hash files to great success. I was a little shocked to come here and search the forums for additional information to find the Big Kahunas basically saying they aren't all t...

I only got list of files once at a time, I need to pick one file name at a time Have you looked into the Folder stage? It was built to help with the processing of XML data from what I've read, but it does allow one to pull a list of filenames from a folder based on user supplied criteria. It would ...

What exact version of DataStage and what flavor of UNIX? I've found that on my system, with 7.0.1 and HP/UX, it doesn't matter what I specify for the SMTP server - it isn't used. It uses whatever default SMTP server or gateway the SAs setup on the box, from what I remember. You may be able to affect...

It's happening again right now, and I see what is causing the problem. Not sure why, but it is the highlight keyword when working from search results or the 'new' posts on the front page. For example: http://www.dsxchange.com/viewtopic.php?t=89648&highlight=distributed This gives me the 404 error. R...

I could tell you what it is for Oracle, but not DB2. Simplest thing to do would be to create a little test job for this scenario and cause certain errors to occur. Capture the reject link information for Link Output fields such as DBMSCODE, SQLSTATE, LASTERR (etc) and see which ones are the ones you...

I'm not sure that it will make a difference, but what database? In general, sending unchecked inserts down a link will generate warnings if the insert generates a duplicate key error - and I really don't know of any way to turn that off. Set your warning limit to 'unlimited' for the job and live wit...

And there's a nice little DOS batch file over in the file library on ADN that will automate the exports of all project on a server.

What error?

Thanks Ray.

A couple of additional thoughts... Using hash files in your project, especially ones processing billions of records, increases your chances of filling up the disk where DataStage is installed. This is a Very Bad Thing and something to be avoided. For a Windows server, I would think it would be best ...

That's Oracle syntax and so would only help if you are loading into Oracle. And you can't simply put "SEQ" in your insert statement, you need to replace it with the name of a legitimate Sequencer object created for your target table. Then, doing what you are doing will autogenerate a surrogate key d...

As noted by Ray:

There is a manual on writing plug-in stages available for asking from Ascential.

mandyli wrote:please try use join stage.

Doesn't really help telling someone to use a PX stage for a Server job.

I think we're at the point in this thread where we need to wait for the OP to come back and comment on all the wonderful advice here. Otherwise, we're just talking to ourselves.

I don't think you can do this from inside the job. What I'd look into doing is running the job from some custom Job Control code where you set the parameter values yourself and then start the job. Before that, you could check the value of your TYPE parameter and set the Warning Limit for the job bas...