Search found 43 matches
- Mon Sep 25, 2017 9:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Oracle Connector - Oracle Bulk Load vs Insert
- Replies: 2
- Views: 4001
Oracle Connector - Oracle Bulk Load vs Insert
Hi, I'm loading 21 million records in a Oracle table and it is taking around 1 hr 30 Minutes to load using Oracle Connector. I used Bulk Load as well as Insert Mode in Oracle. Surprisingly, in both modes Bulk as well as Insert Mode job is taking same time to load. More surprisingly Bulk mode is taki...
- Thu Sep 14, 2017 8:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Passing and Calulating Expression Dynamically
- Replies: 5
- Views: 6022
- Wed Sep 13, 2017 12:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Passing and Calulating Expression Dynamically
- Replies: 5
- Views: 6022
- Wed Sep 13, 2017 7:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Passing and Calulating Expression Dynamically
- Replies: 5
- Views: 6022
Passing and Calulating Expression Dynamically
I'm getting following value of derivation in column flag_value from a table if ((currentMonth <= 3 and ( ((mbrSubPlnAdjEndDt ="") or ((mbrEnrEndDtMonth >= 1) and (mbrEnrEndDtYear >= (currentYear - 1)))))) or (currentMonth > 3 and ( ((mbrSubPlnAdjEndDt ="") or ((mbrEnrEndDtMonth >...
- Mon Oct 31, 2016 7:00 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Connector - After SQL issuing warnings
- Replies: 1
- Views: 2333
Connector - After SQL issuing warnings
In Oracle connector stage I'm executing one After SQL after loading a table. I have set After SQL fail to "No". That is if the After SQL statement fails due to any constraint or any issue then job should not fail. However my job is still throwing a warning due to the failure of After SQL s...
- Wed Oct 26, 2016 8:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Sparse Lookup - Dropping component because of prior componen
- Replies: 1
- Views: 1599
Sparse Lookup - Dropping component because of prior componen
I'm doing a sparse lookup on oracle table on Key but when I'm running job I'm getting error as Dropping component Key because of prior component with same name Key. Actually the column for which it is saying it is dropping due to same name is lookup key only and usually we get this error for other j...
- Fri Sep 30, 2016 12:41 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Transformer lookup on ODBC reference links
- Replies: 3
- Views: 5898
Transformer lookup on ODBC reference links
Hi, I'm converting a server job to parallel job. In server job a file is read and using transformer stage a lookup is done on DB using ODBC stage. My query is if there are multiple records in DB for an input record whether multiple records will be output or any random sigle lookup will be done and o...
- Tue Apr 14, 2015 1:05 am
- Forum: General
- Topic: Regarding Invocation id
- Replies: 4
- Views: 1938
Re: Regarding Invocation id
I think you want to run in parallel assuming your number of files are fixed always & in that case generate a csv file with whatever Parameter set, file name and invocation id you want to pass then using execute command execute sed, cut to get parameter values for each instance and execute parall...
- Fri Apr 10, 2015 12:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Lookup Condition
- Replies: 5
- Views: 5214
Re: Lookup Condition
I think this is the answer
select *from table1 t1
inner join table t2
on t1.col1=t2.col1
where col1 - lookup column & as condition t2.col2='ABC' is not dropping any record it is not required in query.
select *from table1 t1
inner join table t2
on t1.col1=t2.col1
where col1 - lookup column & as condition t2.col2='ABC' is not dropping any record it is not required in query.
- Tue Apr 07, 2015 4:30 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading CSV file with comma and double quotes in Datastage
- Replies: 7
- Views: 8710
- Mon Apr 06, 2015 1:03 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading CSV file with comma and double quotes in Datastage
- Replies: 7
- Views: 8710
- Mon Apr 06, 2015 1:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading CSV file with comma and double quotes in Datastage
- Replies: 7
- Views: 8710
I had tried using unstructured stage but it is not working for csv and in no way parallel job sequential file is working for this. As you said server sequential will work will try it but I'm thinking how we can handle quotes in a particular column as in some case we will get quotes for a column and ...
- Mon Apr 06, 2015 6:26 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading CSV file with comma and double quotes in Datastage
- Replies: 7
- Views: 8710
Reading CSV file with comma and double quotes in Datastage
I'm getting input csv file as 1,"2,2.1",3,"4,4.1". This sample record is having 4 columns with value in first column 1, second column 2,2.1, third column 3 & fourth column 4,4.1, i.e. columns having comma is enclosed in double quotes. Double quotes can be on any column if it'...
- Fri Mar 13, 2015 3:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Double Quotes
- Replies: 4
- Views: 2571
Double Quotes
Hi, In a column when I get value as abc"xyz", I need output as "abc""xyz"". I'm using dquote function but i'm getting output as "abc\"xyz\"".
Could you please suggest is there any simple logic to get "abc""xyz"".
Could you please suggest is there any simple logic to get "abc""xyz"".
- Mon Jun 23, 2014 6:22 am
- Forum: General
- Topic: Confirm encrypted password is set to $PROJDEF?
- Replies: 16
- Views: 9495