Search found 147 matches

by shamshad
Tue Jun 27, 2006 8:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance: Can something be done at Datastage?
Replies: 4
Views: 1516

Performance: Can something be done at Datastage?

Database: DB2 UDB Datastage: 7.5 AIX We have 3 fact tables (50 Million rows in each) in our datamart (EXACTLY SAME LAYOUT) which is being populated through Datastage job. Those 3 tables are then used to create VIEW and Business Objects XI is being used to create reports from that VIEW along with oth...
by shamshad
Wed May 24, 2006 2:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Merging 4 databases table records into 1 database table
Replies: 6
Views: 1487

Merging 4 databases table records into 1 database table

I have 4 DB2-UDB tables with exactly same layout. The data from all those 4 tables are to be moved to a single new table which will have the same layout as other 4 tables. What transform to use to Merge the 4 transformers and then send the one transformer to taget database? Table1--->Transformer1> -...
by shamshad
Tue May 09, 2006 12:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to initialize value of parameters automatically?
Replies: 5
Views: 1562

My guess would be the jobs would be put in a Sequencer and will be scheduled.
by shamshad
Tue May 09, 2006 12:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to initialize value of parameters automatically?
Replies: 5
Views: 1562

How to initialize value of parameters automatically?

We first design out ETL job in TEST and then move to PROD. Most of our jobs uses parameters, most commonly TEST PROD InputFileName : Employee.txt ProdEmp.txt InputFilepath : /local/inputfiles/ /local/prodinputfiles/ OutputFileName : Emplyeeout.txt ProEmp.txt OutputFilepath :/local/outputfiles/ /loca...
by shamshad
Tue May 09, 2006 11:52 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: delete large number of records in DB2
Replies: 17
Views: 16305

Regardless of what ETL Tool one uses, if ETL code is generating one DELETE statement per row to be deleted, it always a database overhead...In most cases when that ETL code runs and it starts firing multiple delete statements, databases server is bogged down by the number of SQL statements.....I hav...
by shamshad
Fri Nov 05, 2004 1:41 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Passing parameters dynamically to more than one jobs
Replies: 4
Views: 1468

Passing parameters dynamically to more than one jobs

Hello folks, I have a sequencer job that consists of more than one jobs. Now in the first job, I need to pass a parameter. When the sequencer runs, it should take the first parameter and calculate a second parameter (second parameter is generated dynamically from database). After the second value (p...
by shamshad
Mon Oct 18, 2004 2:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to populate "SDKSequences" to get correct KeyM
Replies: 3
Views: 1291

How to populate "SDKSequences" to get correct KeyM

Hello, I am new to datastage and need help on this issue. I have two sets of ETL jobs. - One that does the initial load for all the facts and dimensions by clearing the tables and - Other than does only inserts and updates. INITAL LOAD: This runs just for the first time. Before this job run, I run a...
by shamshad
Fri Oct 15, 2004 9:46 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cannot Insert new records into table!!!
Replies: 8
Views: 5372

First of all, many thanks to everyone here who took time to reply. Let me try to explain what's going on. There is one separate job that does a CLEAN insert into all dimension and facts tables. This job is run ONLY THE FIRST TIME. Before this job runs, it run a RESETKEY job that makes all the counte...
by shamshad
Thu Oct 14, 2004 3:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to INSERT and UPDATE
Replies: 6
Views: 2243

SOLVED

I used different methods and this seems to work fine. Instead of checking for NULLS I am checking if it returns any Values or not. I REPLACED IsNull(LookupProdCodes.ProdCode) with Len(Trim(LookupProdCodes.ProdCode))=0 for INSERT Len(Trim(LookupProdCodes.ProdCode))>0 for UPDATES It works!!! Thanks fo...
by shamshad
Thu Oct 14, 2004 3:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Cannot Insert new records into table!!!
Replies: 8
Views: 5372

Cannot Insert new records into table!!!

Hello friends, I desperately need quick help on this: This is the error I am getting "One or more values in the INSERT statement, UPDATE statement, or foreign key update caused by a DELETE statement are not valid because the primary key, unique constraint or unique index identified by "1&q...
by shamshad
Wed Oct 13, 2004 1:30 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to INSERT and UPDATE
Replies: 6
Views: 2243

OK, here is what I am doing step by step (1) Get ProductKey and ProductCode from Target Table (Only Distinct values) (2) Sending it to a HASH file through a transformer after removing any spaces using TRIM for both ProductKey and ProductCode. ProductCode is defined as "KEY" (3) Get the Val...
by shamshad
Wed Oct 13, 2004 11:44 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to INSERT and UPDATE
Replies: 6
Views: 2243

Unable to INSERT and UPDATE

DataStage Version: 5.2 I have a CSV file that contains data (Both old as well as new). I need to UPDATE the existing records and INSERT the NEW records. Below is my CSV Data ProdCode Name Type 90 Shirts U 91 Pants T 92 Shoes M 93 Tie K I am creating a HASH file from the DB2 table and making "Pr...