DSXchange

I agree with Ken the best approach is a scheduler. I have been in the same boat where we had to go through the process of convincing management to get a scheduler. I was finally able to locate a fairly good one that was within their price tolerance. We ended up with ActiveBatch http://www.activebatc...

I wrote code way back in Foxpro and Oracle to convert both ways (integer to/from binary through hexatridecimal). If I recall it was a pretty simple program.

Hmm... I wonder if I still have it somewhere.

Have you looked at what is going on with the Netezza? I have found that it is much faster to bulk load the data into a temporary table and use a SQL statement to join it and pull the data back out for stuff like this. They have added a bulk unload with the new version of the stage but I am not sure ...

Have DataStage check the Netezza load log, for example in an after-job subroutine or in a job sequence downstream of the Job activity. ... At this point we have it fail and look at the logs manually. Ray's suggestion is an option but the logs only exist on the DataStage server if you use the nzload...

Best practice is, indeed, to stage your data at least once between extraction and loading. It is not necessary to do so, merely wise. It means, among other things, that you only have to per ... The only thing that I would add is that I would suggest that you use a parallel dataset instead of a sequ...

Hi Shawn, what were the issues you guys found using plug in stage? are you guys using 7.5.2 or 7.5.3? We have ran into several challenges with the Netezza Stage which mostly revolve around how differently Netezza works. IBM has done quite a bit of work on the stage based on our feedback and now tha...

Shawn - I remember now, I had to write a short DS/BASIC program that goes into the log and cleanses "orphaned" information. I think that might be fixed at V8 and can check that next week. I might also have the code on my PC which cleans up the log and can post it here. Good news is that r...

Hello, This is more of a general question: Where can I find DataStage roadmap information? I have tried emailing IBM, but haven't received a response and the web hasn't been much help. I am trying to get information such as future release information, when they will stop support of legacy versions,...

ArndW wrote:I can think of 2 things:
a) filtering Director entries
b) Automatic purging - this will remove the instance name when the log is purged. ...

Unfortunately automatic purging only clears logs and will not remove the invocation information.

Hitesh, You do not (I really mean DO NOT) want to use the ODBC stage to do an update in Netezza. Netezza has no indexes and the ODBC issues singleton updates. The combination of the two with results in significantly poor performance (we had a table that was updating at a speed of 1 row every 15 seco...

This should do it. It will authenticate you to the server privnet22 and allow you to use you UNC names to copy. net use \\privnet22 <password> /USER:<domain>\<username> Replace <password> with the password of the user you are using for the connection Replace <domain> with the domain of server that t...

I would take Ray's advice and wrap the call to dsjob in a shell script and have the shell script translate the exit code.

You need to have an input link of some sort. The row generator works if you want to process 1 file. I have also used the external source to get a list of files using a unix find. In either case you set the input tab to URL/Filepath and the XML stage will handle the rest.

We have a load ID column in our tables that we use for audit and validation processes. We generate an ID (that is logged in a control table) and all jobs in a sequence will tag new rows with the load ID. That way we can use the id for validation counts, sums, etc as well as bulk deletions on a faile...

If you are like me and trying to do this outside of a datastage job you will have to set the APT_CONFIG_FILE environment variable also.