Search found 33 matches

by bman
Tue Apr 29, 2008 8:49 pm
Forum: IBM<sup>®</sup> DataStage TX
Topic: Information server and WTX
Replies: 1
Views: 3307

Information server and WTX

Hi I have couple of baisc questions on WTX ( I saw couple of questions in similiar lines in this frum but am still not clear on the below points ) 1. Is WTX part of IBM InformationServer suite ? I do have IBM information server suite but It has only Datatsage/Quality stage client. 2. Can the compone...
by bman
Fri Apr 25, 2008 3:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number instances of a DS job at a time
Replies: 11
Views: 11670

Hi, Continuing on this thread, I just tried running the flow and tried to capture all the process started as part of it by greping the process running under the userid... I can see too many osh process as below, userid 307528 749948 0 15:19:48 - 0:00 /appl/infoserver/Server/PXEngine/bin/osh -APT_PMs...
by bman
Tue Apr 22, 2008 4:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Jobhandle is retruned as 0
Replies: 0
Views: 770

Jobhandle is retruned as 0

Hi, Got a query regarding the DSAttachJob command. I am using an exception handler sequence to trigger a routine which will fetch all the FATAL log entries form the job that is aborted in the sequence. It works fine if the sequence is single instance. But for a multi instance sequence routine is not...
by bman
Fri Apr 18, 2008 12:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number instances of a DS job at a time
Replies: 11
Views: 11670

Hi, That is what I am doing now. Running only 10 instances at a time, and each time new instance needs to started the scrpt gets count of the total number of job instance running and start a new instance only if instance count is less than 10 else it sleeps for a while. But I am curious on the numbe...
by bman
Wed Apr 16, 2008 9:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Maximum number instances of a DS job at a time
Replies: 11
Views: 11670

Maximum number instances of a DS job at a time

Hi Is there a limit to the number of instance of a job that can be run simultaniously for a multiinstance job ? I tried running one of my multi instance job first 10 instance at a time, then 30 at a time and then 80 at a time. No job failure reported when I ran 10 instance at a time. Couple of insta...
by bman
Tue Apr 08, 2008 1:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multi instance Job fails with Status 99(Not Runing)
Replies: 5
Views: 3626

I would like add one mor epoint here..
Only the Sequence is getting aborted with Status code 99( not running error). As per the job log it has succesfully completed the run
by bman
Tue Apr 08, 2008 12:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multi instance Job fails with Status 99(Not Runing)
Replies: 5
Views: 3626

Hi Ray,

Invocation id is unique as it is same as th einput file name. I have run the job just keeping te Jobsequence1 and removng all the downstream jobs but I am getting the same error
by bman
Mon Apr 07, 2008 3:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Multi instance Job fails with Status 99(Not Runing)
Replies: 5
Views: 3626

Multi instance Job fails with Status 99(Not Runing)

Hi I have a problem with one of my multiinstance job flow. I have a multi instance flow as below, Sequence 1: JobSequence1 --> JobSequence2 -->SequenceSequence (-----Job 1-----) (-----Job 2------) (-----Sequence2---- ) Sequence2: LoopStart --> JobSequnece3 ----> Routine ----> JobSequnece2 --> EndLoo...
by bman
Tue Mar 18, 2008 3:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Archiving Sequential file when the job is running
Replies: 3
Views: 1763

Archiving Sequential file when the job is running

Hi I have a parallel job that writes to a sequential file. My requirement is to archive the file whenver the size reaches a limit so that the size of the file will not be non manageable. But I am finding it difficult to back up the file when the job is running. I tried the below method, Sequential f...
by bman
Fri Mar 14, 2008 1:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ to MQ - Realtime batch processing
Replies: 9
Views: 4234

Thanks Ernie for taking your time for me and getting into the issue .. I have gone with the xslt transformer as I had issue with the End of wave processing with the xml out stage ( I posted a query on that too some days back :( as there is a requirement cretae multiple repeating segments). One messa...
by bman
Fri Mar 14, 2008 12:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ to MQ - Realtime batch processing
Replies: 9
Views: 4234

I said perfomance issue because the MQ connector stage reads messages from queue at very slow rate. The rate is like 10 messages per second and with this rate processing 1 million records take too much of time ? This is why I started thinking of increasing the record count ? I cant see any other bot...
by bman
Thu Mar 13, 2008 9:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ to MQ - Realtime batch processing
Replies: 9
Views: 4234

Hi Ernie, Actually messages are not coming in batch but one at a time. And the publisher publishes more than a million records in avery short span. My job was picking up messages one at atime but this is causing perfomance issue and I thought of changing the transaction count to 100. But I am really...
by bman
Thu Mar 13, 2008 3:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ to MQ - Realtime batch processing
Replies: 9
Views: 4234

MQ to MQ - Realtime batch processing

Hi, Is it possible to have an MQ to MQ job which runs as an always on job and at the same time process messages in batch ? What I mean is, run the MQ IN stage with wait time -1, message count -1 and Record count = 100. and The job flow as, MQ -> Transformer ->MQ Job runs fine untill the last batch. ...
by bman
Mon Mar 10, 2008 12:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ input stgae Transactional processing
Replies: 1
Views: 1078

MQ input stgae Transactional processing

Hi, I have a Job which reads from an MQ does transformation and then send it over webservice. I wanted to make the job transactional so that incase there is a failure in job, job gets aborted and the message is rolled back to the queue so that I can process it again. I thought it was working fine fo...
by bman
Fri Mar 07, 2008 5:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ stage- Server Vs Parallel job - issue
Replies: 3
Views: 2048

Somewhat similiar to the issue I have with my real time MQ interface. You can try setting the End of Wave to After and see. It should work or atleast it worked for me when I have a direct flow ( I mean no branching out ) after MQ stage till the database I came accross this bolg from ernie on the rea...