Hi,
I faced this problem couple of years back. It was due to job log. The job was called in loop(min 400 times). It started running slowly whenever there was a failure.
Cleaning up the job logs solved the issue.
Thanks.
Bharathappriyan
Search found 45 matches
- Thu Jul 28, 2016 10:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Disk IO issue - Longer Job run time
- Replies: 19
- Views: 10618
- Fri Dec 05, 2014 9:13 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How can i extract value from a string?
- Replies: 1
- Views: 5238
How can i extract value from a string?
Hi, I want parse the data between CommentBody></CommentBody> in a string. It can be more than one. Ex: One record has below value. <CommentHeader>Header1<CommentDate>2013-01-27-14.10.56.000000 </CommentDate><StageNbr>10</StageNbr></CommentHeader><CommentBody></CommentBody><CommentHeader>Header2 <Com...
- Fri Dec 05, 2014 7:20 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to split the xml data?
- Replies: 0
- Views: 3854
How to split the xml data?
Hi, Could you please provide your suggestions? I have table column with varchar(4000). It has data as below: Record 1 has one xml. Record 2 have two xmls. Record 3 has one xml. Record 5 has six xmls. Requirement: If the column has <CommentHeader> only xmls, then parse the data from commentBOdy and c...
- Wed Sep 24, 2014 8:14 am
- Forum: General
- Topic: Do we need a separate database for each ETL server?
- Replies: 4
- Views: 2971
- Wed Sep 24, 2014 7:47 am
- Forum: General
- Topic: Do we need a separate database for each ETL server?
- Replies: 4
- Views: 2971
Do we need a separate database for each ETL server?
Hi,
Do we need a separate database for each ETL server?. In my project, two schemas are created instead of two ETL servers. Why do we need to have two schemas or databases for two etl server?
Thanks,
Bharathappriyan
Do we need a separate database for each ETL server?. In my project, two schemas are created instead of two ETL servers. Why do we need to have two schemas or databases for two etl server?
Thanks,
Bharathappriyan
- Wed Sep 10, 2014 8:04 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: windows command to check 32 bit or 64 bit hashed file
- Replies: 2
- Views: 4116
- Mon Sep 08, 2014 10:50 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: windows command to check 32 bit or 64 bit hashed file
- Replies: 2
- Views: 4116
windows command to check 32 bit or 64 bit hashed file
Hi,
I am trying to find out the hashed files created is a 32 bit file or 64 bit file. I found the following link. I am new to windows OS. What is the equivalent windows command for unix command od -x DATA.30 | head -1?
Thanks,
Bharathappriyan
I am trying to find out the hashed files created is a 32 bit file or 64 bit file. I found the following link. I am new to windows OS. What is the equivalent windows command for unix command od -x DATA.30 | head -1?
Thanks,
Bharathappriyan
- Mon Jul 28, 2014 12:20 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Update previous records with yesterday's date
- Replies: 9
- Views: 9077
Re: Update previous records with yesterday's date
Hi,
Sort the data based on start_dt desc. Assign yesterday's date as Start date and the High end date as end date for employee's first record. For the second record, use (Previous record's start date -1 ) as end date.
Thanks,
Bharathappriyan
Sort the data based on start_dt desc. Assign yesterday's date as Start date and the High end date as end date for employee's first record. For the second record, use (Previous record's start date -1 ) as end date.
Thanks,
Bharathappriyan
- Wed Jul 09, 2014 12:13 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Split the column into rows
- Replies: 4
- Views: 7129
- Wed Jul 09, 2014 6:37 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Split the column into rows
- Replies: 4
- Views: 7129
- Tue Jul 08, 2014 8:37 am
- Forum: General
- Topic: Getting dependent jobs and files
- Replies: 3
- Views: 2445
Getting dependent jobs and files
Hi, I have 5 Master sequences. Each sequence has more than 10 sequence jobs inside them which are calling the individual jobs. All the 5 master sequences are scheduled to run in sequence which is taking more time. I am planning to run some the master sequences in parallel to reduce the run time. Hen...
- Wed May 21, 2014 6:59 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Writting into hashed files is taking lot of time
- Replies: 2
- Views: 3410
Writting into hashed files is taking lot of time
Hi, We have an ETL job which creates the Hashed file and used for look up purpose in the same job. If there is a record missing, the same is written in the file in another link. The input record count is 16 millions. The job is taking around 2 hours to create the file itself. It was taking 45 mins t...
- Fri Apr 18, 2014 12:55 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unique record counter-Hash partitioning before transformer
- Replies: 8
- Views: 4550
- Tue Apr 08, 2014 10:57 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to find the last link of an etl job?
- Replies: 10
- Views: 6496
- Mon Apr 07, 2014 8:18 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to find the last link of an etl job?
- Replies: 10
- Views: 6496
How to find the last link of an etl job?
Hi, DataStage: 7.5 OS: Windows Is there a way to find the last link of an ETL job?. My requirement is to find out the start time, end time, status & rows processed by an etl job present in a project. The project has around 5000 jobs. We have an routine to give the start time, end time and status...