Search found 43 matches

by syedmuhammedmehdi
Mon Sep 25, 2017 9:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Connector - Oracle Bulk Load vs Insert
Replies: 2
Views: 4001

Oracle Connector - Oracle Bulk Load vs Insert

Hi, I'm loading 21 million records in a Oracle table and it is taking around 1 hr 30 Minutes to load using Oracle Connector. I used Bulk Load as well as Insert Mode in Oracle. Surprisingly, in both modes Bulk as well as Insert Mode job is taking same time to load. More surprisingly Bulk mode is taki...
by syedmuhammedmehdi
Thu Sep 14, 2017 8:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing and Calulating Expression Dynamically
Replies: 5
Views: 6022

Yes, Thanks Mike, I'm creating Temp Table in DB with those variables as column and then doing custom derivation in SQL and it is working.
by syedmuhammedmehdi
Wed Sep 13, 2017 12:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing and Calulating Expression Dynamically
Replies: 5
Views: 6022

Hi Mike, thanks but please advise "bunch of nested if else" what do u mean?
by syedmuhammedmehdi
Wed Sep 13, 2017 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Passing and Calulating Expression Dynamically
Replies: 5
Views: 6022

Passing and Calulating Expression Dynamically

I'm getting following value of derivation in column flag_value from a table if ((currentMonth <= 3 and ( ((mbrSubPlnAdjEndDt ="") or ((mbrEnrEndDtMonth >= 1) and (mbrEnrEndDtYear >= (currentYear - 1)))))) or (currentMonth > 3 and ( ((mbrSubPlnAdjEndDt ="") or ((mbrEnrEndDtMonth >...
by syedmuhammedmehdi
Mon Oct 31, 2016 7:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connector - After SQL issuing warnings
Replies: 1
Views: 2333

Connector - After SQL issuing warnings

In Oracle connector stage I'm executing one After SQL after loading a table. I have set After SQL fail to "No". That is if the After SQL statement fails due to any constraint or any issue then job should not fail. However my job is still throwing a warning due to the failure of After SQL s...
by syedmuhammedmehdi
Wed Oct 26, 2016 8:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sparse Lookup - Dropping component because of prior componen
Replies: 1
Views: 1599

Sparse Lookup - Dropping component because of prior componen

I'm doing a sparse lookup on oracle table on Key but when I'm running job I'm getting error as Dropping component Key because of prior component with same name Key. Actually the column for which it is saying it is dropping due to same name is lookup key only and usually we get this error for other j...
by syedmuhammedmehdi
Fri Sep 30, 2016 12:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Transformer lookup on ODBC reference links
Replies: 3
Views: 5898

Transformer lookup on ODBC reference links

Hi, I'm converting a server job to parallel job. In server job a file is read and using transformer stage a lookup is done on DB using ODBC stage. My query is if there are multiple records in DB for an input record whether multiple records will be output or any random sigle lookup will be done and o...
by syedmuhammedmehdi
Tue Apr 14, 2015 1:05 am
Forum: General
Topic: Regarding Invocation id
Replies: 4
Views: 1938

Re: Regarding Invocation id

I think you want to run in parallel assuming your number of files are fixed always & in that case generate a csv file with whatever Parameter set, file name and invocation id you want to pass then using execute command execute sed, cut to get parameter values for each instance and execute parall...
by syedmuhammedmehdi
Fri Apr 10, 2015 12:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup Condition
Replies: 5
Views: 5214

Re: Lookup Condition

I think this is the answer

select *from table1 t1
inner join table t2
on t1.col1=t2.col1

where col1 - lookup column & as condition t2.col2='ABC' is not dropping any record it is not required in query.
by syedmuhammedmehdi
Mon Apr 06, 2015 1:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading CSV file with comma and double quotes in Datastage
Replies: 7
Views: 8710

chulett wrote:
prasson_ibm wrote:Try to read the file with comma delimited and do not mention double quote in the job in file definition.
So their four columns will read / be parsed as six? Not really sure how that will help. :?
Yes, I agree this will not work.
by syedmuhammedmehdi
Mon Apr 06, 2015 1:01 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading CSV file with comma and double quotes in Datastage
Replies: 7
Views: 8710

I had tried using unstructured stage but it is not working for csv and in no way parallel job sequential file is working for this. As you said server sequential will work will try it but I'm thinking how we can handle quotes in a particular column as in some case we will get quotes for a column and ...
by syedmuhammedmehdi
Mon Apr 06, 2015 6:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading CSV file with comma and double quotes in Datastage
Replies: 7
Views: 8710

Reading CSV file with comma and double quotes in Datastage

I'm getting input csv file as 1,"2,2.1",3,"4,4.1". This sample record is having 4 columns with value in first column 1, second column 2,2.1, third column 3 & fourth column 4,4.1, i.e. columns having comma is enclosed in double quotes. Double quotes can be on any column if it'...
by syedmuhammedmehdi
Fri Mar 13, 2015 3:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Double Quotes
Replies: 4
Views: 2571

Double Quotes

Hi, In a column when I get value as abc"xyz", I need output as "abc""xyz"". I'm using dquote function but i'm getting output as "abc\"xyz\"".

Could you please suggest is there any simple logic to get "abc""xyz"".
by syedmuhammedmehdi
Mon Jun 23, 2014 6:22 am
Forum: General
Topic: Confirm encrypted password is set to $PROJDEF?
Replies: 16
Views: 9495

There's an even simpler way: use the export to file function in Administrator's environment variables screen. You can temporarily create an encrypted variable, give it the "value" of $PROJDEF, and examine the exported file. Your encrypted string will be there. thanks, I tried it, this is ...