Search found 87 matches

by Raamc
Tue Aug 16, 2011 6:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job v/s Stored Procedure
Replies: 3
Views: 2530

Thanks Sura for the Suggestion.

I started writing the PROC, before that I just want to know whether any others come across the same situation and their ideas about this?

And regarding the Indexes, Yes the tables are having the indexes on the columns which I am using in joins.
by Raamc
Tue Aug 16, 2011 5:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ETL Job v/s Stored Procedure
Replies: 3
Views: 2530

ETL Job v/s Stored Procedure

Hi All, I have a query regarding the tuning a datastage job. My requirement is to read 10 millions of data from a table and do a lookup (Left outer join) on some other table which is on same database, then insert the data into some other table. My ETL job for above requirement is taking more than 10...
by Raamc
Thu Jul 14, 2011 11:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Message Handler
Replies: 3
Views: 2816

Hi theone, Thanks for the reply. But in some cases, we can see these two different kinds of warnings from same table. That means, job is having only one table with PRIMARY_KEY and NOT NULL columns, so records are rejected due to PRIMARY_KEY violations and some other are due to NON NULL constraint. B...
by Raamc
Wed Jul 13, 2011 12:03 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Message Handler
Replies: 3
Views: 2816

Hi All,

Any ideas of this issue, I am still trying for some work around. Any one can suggest?
by Raamc
Tue Jul 12, 2011 5:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Message Handler
Replies: 3
Views: 2816

Issue with Message Handler

Hi All, I need to insert data coming from a file into two different target tables. First table is having a PRIMARY-KEY and second table is having some NON NUL able columns. I added a message handler in my job to handle PRIMARY KEY violation warnings (I created a new message handler to handle the mes...
by Raamc
Tue Dec 21, 2010 4:04 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copying Dataset Data into a Sequential file
Replies: 2
Views: 2268

Thanks Ray, I got it now.
by Raamc
Tue Dec 21, 2010 3:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copying Dataset Data into a Sequential file
Replies: 2
Views: 2268

Copying Dataset Data into a Sequential file

Hi All,

Is there any way to copy the dataset data into a sequential file?

I need to write a UNIX script which will accept dataset name as input parameter, read that dataset and copy the data into a specified sequential file.

Is it possible to do this using shell scripting?
by Raamc
Mon Sep 27, 2010 2:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: problem in reading sequential file in parallel job
Replies: 1
Views: 1722

problem in reading sequential file in parallel job

I need to read a sequential file that is created in some other processses .It is created with the following options Record Level Final delimeter =end Record Delimeter String =Dos format Field Defaults Delimeter = tab Null field value = ' ' I need to read the file as a single row. By using server job...
by Raamc
Thu Mar 04, 2010 10:38 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NVARCHAR issue while updating Data in Oracle
Replies: 4
Views: 8650

Length's are same for all the columns Ray. Only VARCHAR to NVARCHAR and CHAR type to NCHAR are converted while importing the metadata.

And regarding the UNICODE, can you please explain a bit more?
by Raamc
Thu Mar 04, 2010 9:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NVARCHAR issue while updating Data in Oracle
Replies: 4
Views: 8650

NVARCHAR issue while updating Data in Oracle

Hi All, I have a job which update data in a table in Oracle. While importing the metadata from datastage by using ODBC meta data connectivity, Datastage converted all VARCHAR datatypes into NVARCHAR type. I am using the same meta data while updating the same table after few joins in my job. This job...
by Raamc
Wed Nov 18, 2009 9:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance with Change Capture Stage
Replies: 7
Views: 7392

Thanks Arndw, I am not doing the updates. Some other system will do the updates and that updates will flow into my system. I can find changes only by comparing before and after images. Any performace tunning methods before using CHANGE CAPTURE stage. I am sorting the data other than this any other t...
by Raamc
Wed Nov 18, 2009 9:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance with Change Capture Stage
Replies: 7
Views: 7392

Thanks Arndw, I am not doing the updates. Some other system will do the updates and that updates will flow into my system. I can find changes only by comparing before and after images. Any performace tunning methods before using CHANGE CAPTURE stage. I am sorting the data other than this any other t...
by Raamc
Wed Nov 18, 2009 8:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance with Change Capture Stage
Replies: 7
Views: 7392

Performance with Change Capture Stage

Hi, I have a requirement to compare a table before update and after update. I have 10 columns in each record and table is having around 20 millions of records. I want to run a comparison over 20 millions of records. In this case, is it feasible to use CHANGE CAPTURE stage to get the differences (ins...
by Raamc
Wed Oct 21, 2009 11:23 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Extra character at the end of file
Replies: 2
Views: 1688

Thanks Chulett,

That solved my problem.

Thank you very much..
by Raamc
Wed Oct 21, 2009 9:34 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: FTP a file with TIMESTAMP in name
Replies: 3
Views: 2910

I got a work around for this. I am addding the current timestamp in the name of the file, FTPing through the .bat script in windows.

I am dropping the Datastage job which is doing FTP as there is no way to pass dynamic timestamp to the file name in FTP stage.