Search found 15603 matches

by ArndW
Fri Nov 04, 2005 12:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CDC Stage
Replies: 10
Views: 5898

You could submit this to IBM/Ascential support and see if there is an alternative. We'd be curious to hear what the response it.
by ArndW
Fri Nov 04, 2005 11:09 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LPAD equivalent in DS
Replies: 5
Views: 2781

The function/derivation you are looking for is FMT(In.Column,'5"0"R')
by ArndW
Fri Nov 04, 2005 11:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: CDC Stage
Replies: 10
Views: 5898

Kab123, there are a few who use CDC. Yours would be the first post that I see where no answer at all is forthcoming. I get the same warning for all columns that are neither key nor used for CDC and think that this is just the way that things work, I can only get use a handler to demote the message t...
by ArndW
Fri Nov 04, 2005 9:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: duplicate rows from oracle when running in parallel
Replies: 5
Views: 1047

I am mystified. Can you run the job on a temporary 1-node configuration file and see if the duplicates go away (or on a 4-node to see if they multiply). Also, do you specify the Oracle stage "partition" value?
by ArndW
Fri Nov 04, 2005 9:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Difference Between RESET and COMPILE??
Replies: 3
Views: 2098

I tend to re-compile jobs when working on them and they abort; but for server jobs at least both will result in a program that is in a runnable state. The RESET has additional function of checking data sources and targets and I find that this can take longer to check uneccessarily than a quick recom...
by ArndW
Fri Nov 04, 2005 8:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: duplicate rows from oracle when running in parallel
Replies: 5
Views: 1047

Odd.

Do you have a 2-node configuration and do the duplicate rows show up together in your text file? You should be using the "Auto" partitioning going into your transformer stage, and I cannot change my Oracle enterprise stage away from sequential here :(.
by ArndW
Fri Nov 04, 2005 8:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: duplicate rows from oracle when running in parallel
Replies: 5
Views: 1047

By default that is what PX does, it doesn't send all rows down all streams unless you explicitly tell it do do so by specifying "entire" for the partitioning algorithm.

How are you ascertaining the row duplications in your job?
by ArndW
Fri Nov 04, 2005 5:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: very slow executing of job with db2 stage
Replies: 1
Views: 886

Piotrek, you have the option of doing bulk inserts in DB/2, are you doing this or using some form of update/insert? Is this table partitioned - if so then the PX load ought to be faster than a server job. Do other tables load faster? Does this table have constraints/triggers or is it some form of a ...
by ArndW
Fri Nov 04, 2005 4:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Connect to Database using Job control
Replies: 8
Views: 2440

Sreenivasulu, I won't argue with your stating that you "need" to connect to Oracle from the job control; since there are other easier methods of doing this - i.e. writing a dummy job that takes your SQL command as a parameter and uses that in a OCI or ODBC stage. Since you can run unix scripts from ...
by ArndW
Thu Nov 03, 2005 1:51 pm
Forum: Site/Forum
Topic: Write a Book!
Replies: 40
Views: 20404

I don't recognize that quote, but I think if we continue along this vein someone is going to put us on double secret probation :wink:
by ArndW
Thu Nov 03, 2005 10:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: recursive Routine
Replies: 3
Views: 952

Your DEFFUN is fine, but a function returns a value, so needs to be part of an assignment statement. You need to specify a line like:

Code: Select all

Ans = GetWorkDayFromHash(HashTable,HashKey)
by ArndW
Thu Nov 03, 2005 10:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequence thinks job is not runnable
Replies: 6
Views: 2152

The first paragraph was too obscure, sorry. The DSAttachJob() routine is written in the BASIC language, as are many DS internal functions and routines. I think that when the job log is cleared a filelock is taken, but my system here is too fast to let me confirm that. Can you change your autopurge s...
by ArndW
Thu Nov 03, 2005 10:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: filter command question ?
Replies: 18
Views: 4295

No direct problem, except the scripts wants a complete file but is only getting one row per call. Create a pipe somewhere on your system with mkfifo mypipe.fifo Execute a shell command at the beginning of the job in the before-job call doing a nohup {yourscript} mypipe.fifo param2 param3 &...
by ArndW
Thu Nov 03, 2005 9:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequence thinks job is not runnable
Replies: 6
Views: 2152

Since the log file is present, the failure to open the log file should only come if the OPEN statement is executed without the LOCKED option (something Ray always puts in and I never do, I just let it fail in my programs). So if such a statement without a LOCKED clause is used in the DSAttachJob() r...
by ArndW
Thu Nov 03, 2005 8:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Roolback in sequencer
Replies: 3
Views: 1357

I was thinking that you could do a begin-transaction wrapper in a database programming system around every step done and not to do a commit until the end; but that would only work if staying within the database itself - and as long as enough disk space is available. But Craig is right in pointing ou...