Search found 92 matches

by vinodn
Mon Apr 02, 2012 1:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Group Determination
Replies: 2
Views: 915

Group Determination

I need help regarding group ditermination.

My input looks like this. the first 3 columns are my key.

10,20,30,A
10,20,30,X
10,20,40,B
10,20,50,Y
10,20,50,Z
10,20,60,D

My output need to be

1st o/p :

10,20,30,A
10,20,30,X
10,20,50,Y
10,20,50,Z

2nd o/p
10,20,40,B
10,20,60,D

I can do this by using the count function in the aggregator and where count >1 (by grouping on the 1st 3 columns) can be routed to 1st output and count =1 to the 2nd output, I want to know if this can be done in the transformer(like the dedup logic).

Thanks for your help.
by vinodn
Tue Feb 21, 2012 9:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Connector Roll back Settings
Replies: 2
Views: 1089

Re: Teradata Connector Roll back Settings

Hi Felix,

It doesnt work. I think record count only matters when it is immediae mode.

thanks
by vinodn
Fri Jan 27, 2012 1:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Teradata Connector Roll back Settings
Replies: 2
Views: 1089

Teradata Connector Roll back Settings

Do we have any property in Teradata CONNECTOR to Roll back the mload transactions, if there is a partial load
by vinodn
Mon Oct 17, 2011 8:26 pm
Forum: IBM QualityStage
Topic: Quality Stage Reference match
Replies: 4
Views: 3291

Maintaining reference dataset is a very good point . Thank you very much Ray.
by vinodn
Mon Aug 29, 2011 11:50 am
Forum: IBM QualityStage
Topic: Match specification Run Error
Replies: 3
Views: 5548

Re: Match specification Run Error

I got the below error , when combining two sources of customers ,

two customer data sets I made to one using funnel size . i renamed column name in both the links but forgot to change the legths.

i chaged the lengths to have same in both the links then this issue resolved.
by vinodn
Wed Mar 17, 2010 2:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Route one of Duplicates based on condition
Replies: 9
Views: 3570

Have a lookup on the first set where STATUS='Removed' with the second set, if you find any record then PASS this records to an Sequential Stage which would be your STATUS=IMPLEMENTED records and wherever you won't find PASS them to a Reject Link which would be your STATUS=REMOVED records

Transformer -> Removed ->Rem_dup
->Implemented ->Rem_dup ->Lkp ->IMPLEMENTED
|
REMOVED
by vinodn
Wed Mar 17, 2010 2:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Route one of Duplicates based on condition
Replies: 9
Views: 3570

In the transformer separate two types of records using constraint
1) Status = Removed
2) Status = Implemented

Then use Remove Duplicate Stage and pull either first/last record
by vinodn
Tue Mar 16, 2010 1:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with loading "few" non english characters in
Replies: 6
Views: 9367

Can you try using Unicode across your job
by vinodn
Fri Jan 29, 2010 11:50 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

how to do that parallelisam in Datastage for oracle plugin in v8.0.1
by vinodn
Thu Jan 28, 2010 2:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

yup Chulett,

Tables has been partioned and I am reading from single partition.
but I am using parallel degree concept and trying to read prallel.

SELECT
/*+ PARALLEL(gl.tgltran, 35) */
CACCOUNT, EFFDATE, ENTITY, AU, APPLICATION_ID, SOURCE_ID, TXN_AMT, DEBIT_CREDIT, SERIAL_NUMBER, WORK_DATE, BATCH_NUMBER, SUBMIT_AU, DESCRIPTION, REROUTE_AU, REJECT_CACCOUNT, UISN_NUMBER, GLIDE_CREATE_DATE, CREATED_BY, CREATED_BY_NAME, BATCH_TYPE, LOAN_NUMBER, ORIG_CODE, REV_EFF_DATE, REV_FLAG FROM gl.tgltran PARTITION (#PartitionName#)

partiton table = gl.tgltran

Is this correct, giving the table name to partition table property
by vinodn
Thu Jan 28, 2010 1:16 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

yeah, partition table property has been set and given table name there.
by vinodn
Thu Jan 28, 2010 1:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

I am using datastage 8.0.1 and it doesn't have oracle connector stage.

Is there any other way to implement parallel concept here.
by vinodn
Wed Jan 27, 2010 3:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

if you see below log from director, it says it's using 4 nodes

main_program: This step has 1 dataset:
ds0: {op0[4p] (parallel GL001P)
=>
/opt/IBM/data/drm_fy_datamart/temp/GL001P.ds}
It has 1 operator:
op0[4p] {(parallel GL001P)
on nodes (
node1[op0,p0]
node2[op0,p1]
node3[op0,p2]
node4[op0,p3]
)}
It runs 4 processes on 4 nodes.
by vinodn
Wed Jan 27, 2010 3:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

Thanks for your response Ray.

how to program in stage to utilise 4 node configuration while reading data from oracle table partition,

Ray- are you trying to say though datastage has 4 node configuration but orace EE stage can't utilise parallelisam and it will read data with only one node.
Does it mean, by default it will just use one node, if yes.

Is there any work around to improve it.

Thanks for your inputs.
by vinodn
Wed Jan 27, 2010 3:43 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle plugin not reading parallel
Replies: 15
Views: 6965

actually I am reading data from only one partition by using where caluse.

and I have used parallel degree concept in select query but here it should share load across nodes right.

How can I make data shared between all 4 nodes to improve performance