Search found 15 matches

by DS_TM
Tue Apr 17, 2012 3:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Edit table definition & reflect on referenced job automa
Replies: 2
Views: 2178

Edit table definition & reflect on referenced job automa

Hi,

Is there any way to achieve this scenario in PX 8.5 or above -- "Edit/Import any existing table definition and those changes automatically reflect on reference jobs column definition" ?
by DS_TM
Fri Apr 29, 2011 3:48 am
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

The project default is always set, even if the setting is "not enabled". If it's changed, the changes only affect jobs created/imported after the change has been wrought. Thank you very much for patiently answering all my questions Ray!!! I have another one, what is the purging project de...
by DS_TM
Thu Apr 28, 2011 2:50 am
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

What if a given job is imported before the project default is set?
by DS_TM
Thu Apr 28, 2011 1:47 am
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

Ray,
No one did in 7.5 server as well since I created a new job without any manual intervention.

Also, I don't find the \\PURGE.SETTINGS in log hashed file and it purges the entries as per the project default. Then how do I confirm if the purge is enable for that particular job?
by DS_TM
Tue Apr 26, 2011 1:37 am
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

Ray, In my case no one is overriding the default setting. Just curious to know how it got into RT_LOG in 7.5 and not on 8.1? If I stick to your observations then how can I verify that a given job is enforced for project level purging? So, that I can scan through all the jobs with corresponding purge...
by DS_TM
Wed Apr 20, 2011 11:45 pm
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

I am still not clear Ray. This was a new job created by me without any manual intervention on RT files. These commands were executed on UNIX box immediately after creating this simple job "Test".

There looks be difference in 7.5 and 8.1 //PURGE.SETTINGS record in RT_LOG files.
by DS_TM
Mon Apr 18, 2011 5:27 am
Forum: General
Topic: Project Level Auto Purge
Replies: 13
Views: 8981

Project Level Auto Purge

Hi, We have enable the auto purge at the project level on our 8.1 FP1 DS server. I am unable to find the PURGE.SETTINGS control record in our RT_LOGnnn files to reflect the project level purge setting. Inerestingly log entries are cleared as per the project level auto purge settings. The question I ...
by DS_TM
Fri Jan 21, 2011 5:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating Surrogate Key In Basic Transformer Parallel Job
Replies: 6
Views: 6785

Re: Generating Surrogate Key In Basic Transformer Parallel J

Hello Everyone, Just to be more precise about my requirement. I have basic routines to run the in the transformer of a paralle job thus using BASIC transformer is must and also note that writing parallel routine is not in our scope at this moment. While invoking routine for every row I need to gener...
by DS_TM
Fri Jan 14, 2011 12:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Generating Surrogate Key In Basic Transformer Parallel Job
Replies: 6
Views: 6785

Generating Surrogate Key In Basic Transformer Parallel Job

Hi, When I use a BASIC transoformer in a parallel job, by default it runs in parallel on all the nodes as per the configuration file but it doesn't have partitionnum and numpartitions sytem varibales to generate a surrogate key. It only has @INROWNUM which is not sufficient when the job is running i...
by DS_TM
Thu Jan 06, 2011 9:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The set of available nodes for op1 is empty
Replies: 7
Views: 6868

Curious to learn the results of your deliberation. Probably the first place to look would be the APT_CONDUCTOR_NODE environment variable definition. DSParams investigation revealed that PXGridGUIEnabled is set to true which generates the nodepool("conductor") text when compiling on grid-e...
by DS_TM
Wed Dec 29, 2010 5:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The set of available nodes for op1 is empty
Replies: 7
Views: 6868

Hi Ray,
I think the issue is with the DSParams file which got corrupted for some reason. Jobs are running fine when I replaced corrupted DSParams with the working copy from a different project on the same server. I have to investigate corrupted DSParams to figure out the root cause though.
by DS_TM
Wed Dec 29, 2010 1:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The set of available nodes for op1 is empty
Replies: 7
Views: 6868

Ray, I also created a new parallel job row generator->basic transformer->peek which throws similar error. But when I use Node Map Constraint property to "node1" job runs fine. Your expert advice is very much appreciated!!! Node Map Constraint is not set: OSH script # OSH / orchestrate scri...
by DS_TM
Tue Dec 28, 2010 11:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The set of available nodes for op1 is empty
Replies: 7
Views: 6868

Examine the score. Which operator is op1? Does it specify any node pool or disk pool constraint? Hi Ray, Interestingly score shows node pool constraint which is not set in job design though. Not sure how it gets added compile time. When I manually removed the nodepool("conductor") from Os...
by DS_TM
Tue Dec 28, 2010 12:04 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: The set of available nodes for op1 is empty
Replies: 7
Views: 6868

The set of available nodes for op1 is empty

Hi, In our development server I get the below error for one of the jobs which was running fine all these days without any issues. main_program: Fatal Error: The set of available nodes for op1 (parallel DSInput in Copy_of_Pre_CleaneData_Trf). is empty. This set is influenced by calls to addNodeConstr...
by DS_TM
Thu Dec 23, 2010 11:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: remove leading zeros in decimal field in sequential file
Replies: 26
Views: 79118

This won't work if we have value lilke -00000.00100.
akbar2002 wrote:Yes, made a typo. Sorry about that
SV1 : DecimalToString(column_name) --> DataType = VarChar
SV2 : Field(SV1,'.',1) --> DataType = Integer
SV3 : Right(SV1,2) --> DataType = VarChar

Derivation : SV2:'.':SV3 --> DataType = VarChar