Search found 185 matches

by Developer9
Fri Jul 01, 2016 6:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

@ ray,

I was able to verify that information
CPU -Avg -20 %
Memory -Physical/Virtual Free -35/50 GB
Disk Space --Nothing Monitored
Still waiting on IBM feedback on disk i/o issue

Thank you
by Developer9
Thu Jun 30, 2016 10:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

The fork lookup is a potential problem with buffering and deadlocks. @Mike , IBM Replied with link for $TEMP environment variable http://www-01.ibm.com/support/docview.wss?uid=swg21595254 This is morning we experienced one additional job delay in the same sequence. Job1 :(As topic of discussion ) 6...
by Developer9
Tue Jun 28, 2016 3:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

We are facing this issue since couple of months (quite few times in a month ) ..No version upgrade still in 8.7 ..same Job is running fine in production at other times with no issues .Its only certain time (repeatedly at morning runs) have this issue
by Developer9
Tue Jun 28, 2016 10:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

@Mike,

The issue is with datastage to start this job. The actual execution is fast But the Delay is at right after the APT config file read event ..Look up operation not yet started at this point

Code: Select all

main_program: Startup time, 25:34; production run time, 0:01.
by Developer9
Tue Jun 28, 2016 8:37 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

@Mike,

I have graphs for cpu/memory (normal usage)..high disk usage on some at delay runs ..Do we have a in-built tool in IBM Information Server suite to monitor resources ?Involved IBM support but I would like to analyse my end

Thank you
by Developer9
Tue Jun 28, 2016 8:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

What is the size of the file being read? What is the size of the file being written? What other stages are in your job design? What other processes are running on the server at the same time? Are you doing anything in a Before-job subroutine? Mike @ Mike Read /write -20 MB ..No Before-job subroutin...
by Developer9
Tue Jun 28, 2016 8:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

@PaulVL,Here is the design of job Seq File ------->XFM -----------> LKP --------> Dataset (Output) | ^ |---------| (Reference link) No complex transformations in transformer ( some constraints on date fields) for the links to LKP stage. They are on the Same node ..Here is what we have on the config ...
by Developer9
Thu Jun 23, 2016 10:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split file based on Count ..
Replies: 4
Views: 1988

@Chulett,

It can be dynamic ..we would like to split the files for the load balancing for the batch process (they can handle only certain number of employees per file)

Thanks
by Developer9
Thu Jun 23, 2016 4:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split file based on Count ..
Replies: 4
Views: 1988

Split file based on Count ..

Hi , I have a requirement to split a file based on division and count of employees ..Each file contains 2 employees per division only Input DIV EMPLOYEE_NUMBER A A1 A A2 A A3 A A4 B B1 B B2 B B3 B B4 Output File1 File3 A A1 B B1 A A2 B B2 File2 File4 A A3 B B3 A A4 B B4 Design Approach seq --->filte...
by Developer9
Wed Jun 22, 2016 5:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10602

Disk IO issue - Longer Job run time

Hi , We have a simple data stage job that reads from a file and writes to a file and runs about 4-5 minutes but is taking more than 45 minutes in recent weeks quite few times. Director Log: Starting Job name .. main_program: orchgeneral: loaded main_program:orchsort: loaded main_program:orchstats: l...
by Developer9
Wed Jun 15, 2016 10:01 am
Forum: General
Topic: Timed out while waiting for an event,code=-14
Replies: 5
Views: 3150

Re: Timed out while waiting for an event,code=-14

chulett wrote:
Developer9 wrote:Admin Team Prefers us to do at job level.
Yeah... no.
I lost in the game :( to stress that point
by Developer9
Wed Jun 15, 2016 9:59 am
Forum: General
Topic: Timed out while waiting for an event,code=-14
Replies: 5
Views: 3150

Part of those recommendations are changes to the uvconfig file; have you done those? We verified that in the current environment these values are above the specified limits ..so there is no change required. It gives me more insight to these variables impact and various scenarios. Thanks everyone fo...
by Developer9
Tue Jun 14, 2016 11:47 pm
Forum: General
Topic: Timed out while waiting for an event,code=-14
Replies: 5
Views: 3150

Timed out while waiting for an event,code=-14

Hi , I searched for Timed out while waiting for an event,code=-14 :) but due to choice conflict I am asking for a opinion. We had an issue with timed out with one of our job (seq file writes to a dataset) and it was only with single instance .Happened rarely . 07:03:40: Exception raised: @Job_Extrac...
by Developer9
Fri Jun 10, 2016 10:49 am
Forum: General
Topic: Current Run Fatal messages for job list using shell script
Replies: 0
Views: 2160

Current Run Fatal messages for job list using shell script

Hi , I have a requirement to capture fatal and warning messages for the current run based on Sequence job status Here is the code I am using currently ..issue is looping is not working as expected. #!/bin/ksh #------------------------------------------------------------------------------------------...
by Developer9
Wed Jun 08, 2016 4:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ODBC Connector stage for stored procedures execution
Replies: 15
Views: 11849

chulett wrote:Are we still restricting answers to only the ODBC Connector stage? :?
Chulett ,

:) Not really ,if it is achievable through usage of Stored Procedure stage I will re-consider my options on using/testing Stored Procedure stage to work .


Thanks,