Search found 45 matches

by bharathappriyan
Thu Jul 28, 2016 10:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Disk IO issue - Longer Job run time
Replies: 19
Views: 10618

Hi,

I faced this problem couple of years back. It was due to job log. The job was called in loop(min 400 times). It started running slowly whenever there was a failure.

Cleaning up the job logs solved the issue.

Thanks.
Bharathappriyan
by bharathappriyan
Fri Dec 05, 2014 9:13 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How can i extract value from a string?
Replies: 1
Views: 5238

How can i extract value from a string?

Hi, I want parse the data between CommentBody></CommentBody> in a string. It can be more than one. Ex: One record has below value. <CommentHeader>Header1<CommentDate>2013-01-27-14.10.56.000000 </CommentDate><StageNbr>10</StageNbr></CommentHeader><CommentBody></CommentBody><CommentHeader>Header2 <Com...
by bharathappriyan
Fri Dec 05, 2014 7:20 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to split the xml data?
Replies: 0
Views: 3854

How to split the xml data?

Hi, Could you please provide your suggestions? I have table column with varchar(4000). It has data as below: Record 1 has one xml. Record 2 have two xmls. Record 3 has one xml. Record 5 has six xmls. Requirement: If the column has <CommentHeader> only xmls, then parse the data from commentBOdy and c...
by bharathappriyan
Wed Sep 24, 2014 8:14 am
Forum: General
Topic: Do we need a separate database for each ETL server?
Replies: 4
Views: 2971

Hi kduke,

Thanks a lot for your reply.

We are using DataStage 7.5 version as well. Does't it have XMETA? My understaning is that from 8x onwards we have that XMETA schema if i am not wrong.

Thanks,
Bharathappriyan.
by bharathappriyan
Wed Sep 24, 2014 7:47 am
Forum: General
Topic: Do we need a separate database for each ETL server?
Replies: 4
Views: 2971

Do we need a separate database for each ETL server?

Hi,

Do we need a separate database for each ETL server?. In my project, two schemas are created instead of two ETL servers. Why do we need to have two schemas or databases for two etl server?

Thanks,
Bharathappriyan
by bharathappriyan
Wed Sep 10, 2014 8:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: windows command to check 32 bit or 64 bit hashed file
Replies: 2
Views: 4116

Thanks a lot Chulett. It worked. I really appreciate your help.

Thanks,
Bharathappriyan
by bharathappriyan
Mon Sep 08, 2014 10:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: windows command to check 32 bit or 64 bit hashed file
Replies: 2
Views: 4116

windows command to check 32 bit or 64 bit hashed file

Hi,

I am trying to find out the hashed files created is a 32 bit file or 64 bit file. I found the following link. I am new to windows OS. What is the equivalent windows command for unix command od -x DATA.30 | head -1?

Thanks,
Bharathappriyan
by bharathappriyan
Mon Jul 28, 2014 12:20 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Update previous records with yesterday's date
Replies: 9
Views: 9077

Re: Update previous records with yesterday's date

Hi,

Sort the data based on start_dt desc. Assign yesterday's date as Start date and the High end date as end date for employee's first record. For the second record, use (Previous record's start date -1 ) as end date.

Thanks,
Bharathappriyan
by bharathappriyan
Wed Jul 09, 2014 12:13 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Split the column into rows
Replies: 4
Views: 7129

Hi Ray/Chulett,
I was able to resolve this. I used the Hashed file stage. In that i used the type as MS.

I really appreciate all for the help.

Thanks,
Selva
by bharathappriyan
Wed Jul 09, 2014 6:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Split the column into rows
Replies: 4
Views: 7129

Hi Ray/Chulett,

Thanks a lot for your reply. But i am not able to read your messages.

Thanks,
Bharathappriyan
by bharathappriyan
Tue Jul 08, 2014 8:37 am
Forum: General
Topic: Getting dependent jobs and files
Replies: 3
Views: 2445

Getting dependent jobs and files

Hi, I have 5 Master sequences. Each sequence has more than 10 sequence jobs inside them which are calling the individual jobs. All the 5 master sequences are scheduled to run in sequence which is taking more time. I am planning to run some the master sequences in parallel to reduce the run time. Hen...
by bharathappriyan
Wed May 21, 2014 6:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Writting into hashed files is taking lot of time
Replies: 2
Views: 3410

Writting into hashed files is taking lot of time

Hi, We have an ETL job which creates the Hashed file and used for look up purpose in the same job. If there is a record missing, the same is written in the file in another link. The input record count is 16 millions. The job is taking around 2 hours to create the file itself. It was taking 45 mins t...
by bharathappriyan
Fri Apr 18, 2014 12:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unique record counter-Hash partitioning before transformer
Replies: 8
Views: 4550

Hi, If i am not wrong, your reuqirement is to assign a number to unique value for a particular column. But it doesn't need to be in order. if that is the case, when read the data from table create a column with rownum. copy the data in two links. In One link copy the rownum & unique value column...
by bharathappriyan
Tue Apr 08, 2014 10:57 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to find the last link of an etl job?
Replies: 10
Views: 6496

Hi Ray,

80% of the jobs are using naming conventions. 20% are not.

Thanks,
Selva
by bharathappriyan
Mon Apr 07, 2014 8:18 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to find the last link of an etl job?
Replies: 10
Views: 6496

How to find the last link of an etl job?

Hi, DataStage: 7.5 OS: Windows Is there a way to find the last link of an ETL job?. My requirement is to find out the start time, end time, status & rows processed by an etl job present in a project. The project has around 5000 jobs. We have an routine to give the start time, end time and status...