Search found 195 matches

by bobyon
Wed Nov 13, 2013 10:50 am
Forum: General
Topic: On a Grid, where can ulimit be changed?
Replies: 2
Views: 2475

Thanks Craig

That is very helpful.

I think what this is telling me is that best practice will be to set the ulimit values in the dsenv; which by the way is how it has been done in every other shop I have been in.
by bobyon
Wed Nov 13, 2013 8:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Anyway to force job to run on all compute nodes on a grid?
Replies: 11
Views: 7164

OK, an explicit configuration file will do it. Create a job that uses an External Source stage to execute hostname ; ulimit -a and capture all the lines of output into wherever makes sense. This operator should execute on each compute node. Now we are getting to the heart of my question. I have the...
by bobyon
Wed Nov 13, 2013 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Anyway to force job to run on all compute nodes on a grid?
Replies: 11
Views: 7164

lstsaur wrote:So you mean that you want to run a non-grid job on every compute node in a grid?
Actually it does not matter to me if it is a grid enabled job or not. As long as I can get the job to run on all the nodes in the grid.

All I am trying to do is confirm the ulimit settings on each server.
by bobyon
Tue Nov 12, 2013 3:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Anyway to force job to run on all compute nodes on a grid?
Replies: 11
Views: 7164

Thanks for the response Ray. I do understand the dynamic nature of building the config file. What I am trying to find is a way to coax the grid management software to running my job on each of the compute nodes so that I can see the ulimit settings on each and every node. My thought regarding creati...
by bobyon
Tue Nov 12, 2013 11:24 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance issue reading data from Oracle connector
Replies: 16
Views: 9697

I'm stretching here

I presume you are sorting before the join. If you're using a DataStage sort stage have you considered adjusting the memory used to handle the larger record lenghts?
by bobyon
Tue Nov 12, 2013 11:18 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Anyway to force job to run on all compute nodes on a grid?
Replies: 11
Views: 7164

Anyway to force job to run on all compute nodes on a grid?

I am suspsicious that the ulimit settings are not as they should be across all of our compute nodes in the grid. I would like to create a sequence/job that will run on each compute node in the grid and return the results of a couple ulimit statements. I have the few statements that are required (uli...
by bobyon
Tue Oct 22, 2013 10:47 am
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

OK, so those two methods both work in the COUNTRY rule set in both the test dialog and in the job itself. The ISO Country code is being set appropriately now. However, because the COUNTRY rule set only outputs ISO Country and Identifier flag, the FC and FORGN are still in my target file since I pass...
by bobyon
Tue Oct 22, 2013 7:29 am
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

BINGO!

Thanks guys. The * did the trick.

The classification override also worked which is probably the technique I will use going forward since that won't require creating a copy of the COUNTRY set in production.

Thanks guys!
by bobyon
Tue Oct 22, 2013 7:27 am
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

BINGO!

Thanks guys. The * did the trick.

The classification override also worked which is probably the technique I will use going forward since that won't require creating a copy of the COUNTRY set in production.

Thanks guys!
by bobyon
Mon Oct 21, 2013 9:01 pm
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

Hmmmm? I'm still seeing the default results.


Could I have the code in the wrong place?
by bobyon
Mon Oct 21, 2013 6:36 pm
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

Tried it like you recommneded and still getting default values.

Do I have to re-provision after each change?
by bobyon
Mon Oct 21, 2013 5:55 pm
Forum: IBM QualityStage
Topic: PAL syntax question
Replies: 8
Views: 6342

PAL syntax question

What is wrong with this picture: \SUB Input_Modifications =T= "FC" RETYPE [1] 0 =T= "FORGN" RETYPE [1] 0 RETURN \END_SUB I am attempting to get QS to drop those strings (FC and FORGN) from the address. However, it does not seem to be having any effect. I tested the following addr...
by bobyon
Fri Oct 18, 2013 3:02 pm
Forum: IBM QualityStage
Topic: QS, Standardize, and MNS primer
Replies: 1
Views: 3809

QS, Standardize, and MNS primer

Let me begin with I am a DataStage developer. I probably don't know enough about QS to even be qualified to ask questions in this forum. Hoowever, I have been asked to standardize some address data and am doing my best. I have figured out how to use the US Name and address rule sets to do some very ...
by bobyon
Mon Oct 07, 2013 10:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The open files limit is
Replies: 6
Views: 4330

The user-id which is running the job, user-id which has been used to create the node directories, user-id which is used to make communication possible between the grid architecture---- I hope every user-id has ulimit set to unlimited.! We only changef the ulimit setting on the ids that are used for...
by bobyon
Fri Oct 04, 2013 1:06 pm
Forum: General
Topic: Sequence job
Replies: 7
Views: 2950

ray.wurlod wrote:Search DSXchange for DSSendMail to learn how to do it.
Oh Yippee. Only 326 results to look through. :-)