Search found 452 matches

by kaps
Thu Mar 03, 2016 1:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

Thanks for your note Franklin. I thought you said that there is a flaw in 8.x in your first post and moreover this works in Server which is why I thought I will give a try with IBM. I just have one question. Can you tell me why I had to divide the numbers by 100 and 10 like I mentioned in my other p...
by kaps
Wed Mar 02, 2016 5:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

It's a vendor file we receive so I can't change anything. It's Ascii file with packed decimal amounts is what I thought. Please see below for part(some columns) of the actual file. Last record is the Trailer record which I am not taking into account now as I am trying to get other records to work fi...
by kaps
Tue Mar 01, 2016 10:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

Franklin I completed the exercise as you suggested but it still shows 0's when I view data. Have given the CFD after changing it... 01 RECORD_1 (273) 02 RECORDTYPE PIC X(2). 1 2 2 02 SUBSIDIARY PIC X(3). 3 5 3 02 POLICY PIC X(6). 6 11 6 02 DIVISIONNO PIC X(5). 12 16 5 02 CERT PIC X(9). 17 25 9 02 CL...
by kaps
Tue Mar 01, 2016 9:56 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

Ray/Craig, I am able to convert the values using the convert function like advised. Please see below. If Index(DSLink2.AmtPaid,"{", 1) >= 1 Then StringToDecimal(Convert("{","0", DSLink2.AmtPaid)/100) Else If Index(DSLink2.AmtPaid,"}", 1) >= 1 Then StringToDeci...
by kaps
Mon Feb 29, 2016 8:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

I kind of got that craig...My question is more towards why am I getting 0's after applying StringToDecimal function ?
by kaps
Mon Feb 29, 2016 6:30 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

Thanks for the suggestions. When I made it as CHAR(7) then I am able to see the values when I view the data. In Parallel it shows like 002250{ whereas in server it shows correctly like +00225.00 Then I converted the amount in Transformer like StringToDecimal(DSLink2.FieldName) in which the target is...
by kaps
Mon Feb 29, 2016 9:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

I actually don't have a CFD. I exported the table definition from the server job and imported into Parallel job. I am not able to change the Display_Numeric to AlphaNumeric as there is no data type like that. I tried to change it to Varchar but it did not work.
by kaps
Thu Feb 18, 2016 2:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Amount field in Complex Flat File in Parallel Vs Server
Replies: 21
Views: 11330

Amount field in Complex Flat File in Parallel Vs Server

I am having trouble converting a server job to a parallel(v8.7) job which uses Complex flat file stage. Problem is that all of the Amount fields does not show up correct when I do view data in Parallel but works fine in Server. These fields are designed as DISPLAY_NUMBERIC in both versions with the ...
by kaps
Wed Aug 06, 2014 9:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Slowly Changing Dimension Stage and initial Effective Date
Replies: 6
Views: 4772

We use separate set of jobs for initial load to handle such requirements. You can just copy the same set of jobs as initial load jobs and just change what you need to change and run only once.
by kaps
Wed Aug 06, 2014 4:19 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Number of transformer stages affects performance ?
Replies: 20
Views: 12440

Yes. You are missing something. If you look at Ray's last post in this topic you can see missing things. I was just trying to draw conclusion here after performing the tests. Thanks for pointing me to the Redbook somehow I missed that but filter stage is taken just as an example here and what I was ...
by kaps
Tue Aug 05, 2014 4:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Number of transformer stages affects performance ?
Replies: 20
Views: 12440

Ray I have tested the performance as you suggested and did not find much difference between the two stages. Upto 10 million records with 4 small columns the time taken is same between them and when I made it 100 million records job with trasformer stage actually finished 2 sces earlier than the job ...
by kaps
Sat Jul 26, 2014 10:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Number of transformer stages affects performance ?
Replies: 20
Views: 12440

Thanks for all valuable replies. Ray, Can you tell how the problem with one transformer in a job is resolved in newer versions ? Also, in my original question I stated about filter stage and transformer stage comparision. If I use transformer stage to just filter records, Is it going to affect the p...
by kaps
Thu Jul 24, 2014 9:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Number of transformer stages affects performance ?
Replies: 20
Views: 12440

Number of transformer stages affects performance ?

First, I read somewhere that if we you use too many transformer stages in Parallel jobs it affects the performance because it needs to get compiled in c++ but later remember reading that it does not affect performance in newer versions. Can someone tell me if that's true ? Why was it not a problem n...
by kaps
Mon Jun 23, 2014 1:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: WHERE clause of a SQL as Parameter ?
Replies: 3
Views: 3108

Found the issue. It's weird... When you have part of where clause as parm and part in the sql statement it fails...see below... Fails with the following: ------------------------- Select Col1 from Table1 where #Wherecluase# And Cond2 Runs with the following: -------------------------- Select Col1 fr...
by kaps
Mon Jun 23, 2014 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: WHERE clause of a SQL as Parameter ?
Replies: 3
Views: 3108

WHERE clause of a SQL as Parameter ?

Has anyone used the whole Where clause of a SQL as a PArameter to the job ? What I am finding is that it's not recognizing values within quotes... I am trying to do this so that I can make a job a multi instance job...

Thanks