Search found 15603 matches

by ArndW
Tue Oct 09, 2012 5:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job fails with error "Could not alloc memory for
Replies: 21
Views: 6157

Yes, if you just login and check "ulimit -a" then you get that process' information and that might not be the same as that used in DataStage. You can compare the "dsenv" file contents to see if the ulimit values are explicitly expanded in one and not the other, but best would be ...
by ArndW
Tue Oct 09, 2012 4:59 am
Forum: General
Topic: Sequencer with few stage to call multiple parallel
Replies: 7
Views: 1678

You can't do it simply in a job sequence, since call to jobs in sequences are effectively hard-coded at compile-time. There is the command-line "dsjob -run" invocation method which you could call from within a loop in a job sequence, or you could use the DataStage API BASIC calls directly ...
by ArndW
Tue Oct 09, 2012 4:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job fails with error "Could not alloc memory for
Replies: 21
Views: 6157

Please delete your other duplicate thread before someone replies to it.
by ArndW
Tue Oct 09, 2012 4:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job fails with error "Could not alloc memory for
Replies: 21
Views: 6157

Ulimit values for your datastage process are the relevant ones. You could write a datastage sequence that calls the UNIX "ulimit -a" command and check the runtime values.
by ArndW
Tue Oct 09, 2012 4:47 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Stage Server Edition 7.5.3 - Data Masking
Replies: 17
Views: 8027

In addition to what I posted, you could use the UNIX "crypt" and "decrypt" commands to perform your obfuscation.
by ArndW
Tue Oct 09, 2012 4:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup job fails with error "Could not alloc memory for
Replies: 21
Views: 6157

It is possible that the "ulimit" settings are indeed different for the DataStage user on both your machines, as the error message suggests. Have you looked at the values on the two machines?
by ArndW
Tue Oct 09, 2012 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading fixed string and aborting
Replies: 3
Views: 985

The goods news is that the problem can be solved, but you will need to supply more information. Is the file that you are reading declared with fixed width or variable width? Are there column separator characters? If there are column separator characters, then declare your field as VarChar(64) (just ...
by ArndW
Mon Oct 08, 2012 9:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Stage Server Edition 7.5.3 - Data Masking
Replies: 17
Views: 8027

The CRC32 algorithm converts any sized string into a 32-bit number; thus by definition one will have different strings that map to the same CRC32. The algorithm excels in making similar strings into very different numbers. I'm surprised that you have detected collisions in your data using CRC32 and ...
by ArndW
Sat Oct 06, 2012 5:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: left outer join and where caluse
Replies: 6
Views: 2733

So your incoming data to the transform stage after the join is col1 col2 col3 b_col2 b_col3 105 500 507 500 507 105 500 506 500 507 105 101 201 500 507 Your logic in the constraint would seem to be correct. Try to remove the right side of the "AND" and see if you get the expected 1 output ...
by ArndW
Fri Oct 05, 2012 8:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Tuning for CDC Stage
Replies: 5
Views: 2922

did you add $APT_DUMP_SCORE to see if there is an inserted sort, despite not being able to read the complete message?
by ArndW
Fri Oct 05, 2012 6:25 am
Forum: General
Topic: Search for Data File on share drive
Replies: 11
Views: 1935

Yes, that now makes sense, the use of "deploy" confused me, since that usually means to install software or the like. Are you certain that your sequence log contains no more messages regarding executing this batch? You could also put an "ECHO" command as the first line in the bat...
by ArndW
Fri Oct 05, 2012 5:33 am
Forum: General
Topic: Search for Data File on share drive
Replies: 11
Views: 1935

What do you mean in steps 3 and 4?

is "execute_command" your routine? Since your original post stated a job sequence, wouldn't "ExecSH" be sufficient?
by ArndW
Fri Oct 05, 2012 5:18 am
Forum: General
Topic: Sequencer with few stage to call multiple parallel
Replies: 7
Views: 1678

Unfortunately, I can't think of a way to do that with different job names. If it were one job that is multi-instance then a sequece could loop through the instances, but that is not the case here. If it is any consolation, I have a sequence right now that has over 60 different jobs and each of those...
by ArndW
Fri Oct 05, 2012 5:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sequential File to Seq File join behaviour...
Replies: 13
Views: 3580

No, not as far as I know. I've used this behaviour for years with joins/lookups to detect if there was a match -- I'd use a non-nullable column, declare it as nullable on the input link to the join stage and, of course, in the output link and later test with IsNull() in a transform stage. The only t...
by ArndW
Fri Oct 05, 2012 5:10 am
Forum: General
Topic: Issue while running After-job subroutine
Replies: 3
Views: 1407

If you assigned 0 to ErrorCode in your routine, then you won't get that error message (which states that the variable hasn't been assigned).

Your routine will have 2 parameters, the first is what you pass in as a string, the second is the error code. Variables in UV-Basic are case sensitive.