Search found 33 matches
- Tue Apr 29, 2008 8:49 pm
- Forum: IBM<sup>®</sup> DataStage TX
- Topic: Information server and WTX
- Replies: 1
- Views: 3307
Information server and WTX
Hi I have couple of baisc questions on WTX ( I saw couple of questions in similiar lines in this frum but am still not clear on the below points ) 1. Is WTX part of IBM InformationServer suite ? I do have IBM information server suite but It has only Datatsage/Quality stage client. 2. Can the compone...
- Fri Apr 25, 2008 3:47 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Maximum number instances of a DS job at a time
- Replies: 11
- Views: 11670
Hi, Continuing on this thread, I just tried running the flow and tried to capture all the process started as part of it by greping the process running under the userid... I can see too many osh process as below, userid 307528 749948 0 15:19:48 - 0:00 /appl/infoserver/Server/PXEngine/bin/osh -APT_PMs...
- Tue Apr 22, 2008 4:08 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Jobhandle is retruned as 0
- Replies: 0
- Views: 770
Jobhandle is retruned as 0
Hi, Got a query regarding the DSAttachJob command. I am using an exception handler sequence to trigger a routine which will fetch all the FATAL log entries form the job that is aborted in the sequence. It works fine if the sequence is single instance. But for a multi instance sequence routine is not...
- Fri Apr 18, 2008 12:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Maximum number instances of a DS job at a time
- Replies: 11
- Views: 11670
Hi, That is what I am doing now. Running only 10 instances at a time, and each time new instance needs to started the scrpt gets count of the total number of job instance running and start a new instance only if instance count is less than 10 else it sleeps for a while. But I am curious on the numbe...
- Wed Apr 16, 2008 9:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Maximum number instances of a DS job at a time
- Replies: 11
- Views: 11670
Maximum number instances of a DS job at a time
Hi Is there a limit to the number of instance of a job that can be run simultaniously for a multiinstance job ? I tried running one of my multi instance job first 10 instance at a time, then 30 at a time and then 80 at a time. No job failure reported when I ran 10 instance at a time. Couple of insta...
- Tue Apr 08, 2008 1:37 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multi instance Job fails with Status 99(Not Runing)
- Replies: 5
- Views: 3626
- Tue Apr 08, 2008 12:58 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multi instance Job fails with Status 99(Not Runing)
- Replies: 5
- Views: 3626
- Mon Apr 07, 2008 3:37 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Multi instance Job fails with Status 99(Not Runing)
- Replies: 5
- Views: 3626
Multi instance Job fails with Status 99(Not Runing)
Hi I have a problem with one of my multiinstance job flow. I have a multi instance flow as below, Sequence 1: JobSequence1 --> JobSequence2 -->SequenceSequence (-----Job 1-----) (-----Job 2------) (-----Sequence2---- ) Sequence2: LoopStart --> JobSequnece3 ----> Routine ----> JobSequnece2 --> EndLoo...
- Tue Mar 18, 2008 3:24 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Archiving Sequential file when the job is running
- Replies: 3
- Views: 1763
Archiving Sequential file when the job is running
Hi I have a parallel job that writes to a sequential file. My requirement is to archive the file whenver the size reaches a limit so that the size of the file will not be non manageable. But I am finding it difficult to back up the file when the job is running. I tried the below method, Sequential f...
- Fri Mar 14, 2008 1:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ to MQ - Realtime batch processing
- Replies: 9
- Views: 4234
Thanks Ernie for taking your time for me and getting into the issue .. I have gone with the xslt transformer as I had issue with the End of wave processing with the xml out stage ( I posted a query on that too some days back :( as there is a requirement cretae multiple repeating segments). One messa...
- Fri Mar 14, 2008 12:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ to MQ - Realtime batch processing
- Replies: 9
- Views: 4234
I said perfomance issue because the MQ connector stage reads messages from queue at very slow rate. The rate is like 10 messages per second and with this rate processing 1 million records take too much of time ? This is why I started thinking of increasing the record count ? I cant see any other bot...
- Thu Mar 13, 2008 9:04 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ to MQ - Realtime batch processing
- Replies: 9
- Views: 4234
Hi Ernie, Actually messages are not coming in batch but one at a time. And the publisher publishes more than a million records in avery short span. My job was picking up messages one at atime but this is causing perfomance issue and I thought of changing the transaction count to 100. But I am really...
- Thu Mar 13, 2008 3:06 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ to MQ - Realtime batch processing
- Replies: 9
- Views: 4234
MQ to MQ - Realtime batch processing
Hi, Is it possible to have an MQ to MQ job which runs as an always on job and at the same time process messages in batch ? What I mean is, run the MQ IN stage with wait time -1, message count -1 and Record count = 100. and The job flow as, MQ -> Transformer ->MQ Job runs fine untill the last batch. ...
- Mon Mar 10, 2008 12:43 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ input stgae Transactional processing
- Replies: 1
- Views: 1078
MQ input stgae Transactional processing
Hi, I have a Job which reads from an MQ does transformation and then send it over webservice. I wanted to make the job transactional so that incase there is a failure in job, job gets aborted and the message is rolled back to the queue so that I can process it again. I thought it was working fine fo...
- Fri Mar 07, 2008 5:31 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: MQ stage- Server Vs Parallel job - issue
- Replies: 3
- Views: 2048
Somewhat similiar to the issue I have with my real time MQ interface. You can try setting the End of Wave to After and see. It should work or atleast it worked for me when I have a direct flow ( I mean no branching out ) after MQ stage till the database I came accross this bolg from ernie on the rea...