Search found 147 matches
- Tue Jun 27, 2006 8:45 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance: Can something be done at Datastage?
- Replies: 4
- Views: 1516
Performance: Can something be done at Datastage?
Database: DB2 UDB Datastage: 7.5 AIX We have 3 fact tables (50 Million rows in each) in our datamart (EXACTLY SAME LAYOUT) which is being populated through Datastage job. Those 3 tables are then used to create VIEW and Business Objects XI is being used to create reports from that VIEW along with oth...
- Wed May 24, 2006 2:49 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Merging 4 databases table records into 1 database table
- Replies: 6
- Views: 1487
Merging 4 databases table records into 1 database table
I have 4 DB2-UDB tables with exactly same layout. The data from all those 4 tables are to be moved to a single new table which will have the same layout as other 4 tables. What transform to use to Merge the 4 transformers and then send the one transformer to taget database? Table1--->Transformer1> -...
- Tue May 09, 2006 12:46 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to initialize value of parameters automatically?
- Replies: 5
- Views: 1562
- Tue May 09, 2006 12:27 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to initialize value of parameters automatically?
- Replies: 5
- Views: 1562
How to initialize value of parameters automatically?
We first design out ETL job in TEST and then move to PROD. Most of our jobs uses parameters, most commonly TEST PROD InputFileName : Employee.txt ProdEmp.txt InputFilepath : /local/inputfiles/ /local/prodinputfiles/ OutputFileName : Emplyeeout.txt ProEmp.txt OutputFilepath :/local/outputfiles/ /loca...
- Tue May 09, 2006 11:52 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: delete large number of records in DB2
- Replies: 17
- Views: 16305
Regardless of what ETL Tool one uses, if ETL code is generating one DELETE statement per row to be deleted, it always a database overhead...In most cases when that ETL code runs and it starts firing multiple delete statements, databases server is bogged down by the number of SQL statements.....I hav...
- Fri Nov 05, 2004 1:41 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Passing parameters dynamically to more than one jobs
- Replies: 4
- Views: 1468
Passing parameters dynamically to more than one jobs
Hello folks, I have a sequencer job that consists of more than one jobs. Now in the first job, I need to pass a parameter. When the sequencer runs, it should take the first parameter and calculate a second parameter (second parameter is generated dynamically from database). After the second value (p...
- Mon Oct 18, 2004 2:15 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to populate "SDKSequences" to get correct KeyM
- Replies: 3
- Views: 1291
How to populate "SDKSequences" to get correct KeyM
Hello, I am new to datastage and need help on this issue. I have two sets of ETL jobs. - One that does the initial load for all the facts and dimensions by clearing the tables and - Other than does only inserts and updates. INITAL LOAD: This runs just for the first time. Before this job run, I run a...
- Fri Oct 15, 2004 9:46 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Cannot Insert new records into table!!!
- Replies: 8
- Views: 5372
First of all, many thanks to everyone here who took time to reply. Let me try to explain what's going on. There is one separate job that does a CLEAN insert into all dimension and facts tables. This job is run ONLY THE FIRST TIME. Before this job runs, it run a RESETKEY job that makes all the counte...
- Thu Oct 14, 2004 3:19 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to INSERT and UPDATE
- Replies: 6
- Views: 2243
SOLVED
I used different methods and this seems to work fine. Instead of checking for NULLS I am checking if it returns any Values or not. I REPLACED IsNull(LookupProdCodes.ProdCode) with Len(Trim(LookupProdCodes.ProdCode))=0 for INSERT Len(Trim(LookupProdCodes.ProdCode))>0 for UPDATES It works!!! Thanks fo...
- Thu Oct 14, 2004 3:15 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Cannot Insert new records into table!!!
- Replies: 8
- Views: 5372
Cannot Insert new records into table!!!
Hello friends, I desperately need quick help on this: This is the error I am getting "One or more values in the INSERT statement, UPDATE statement, or foreign key update caused by a DELETE statement are not valid because the primary key, unique constraint or unique index identified by "1&q...
- Wed Oct 13, 2004 1:30 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to INSERT and UPDATE
- Replies: 6
- Views: 2243
- Wed Oct 13, 2004 11:44 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Unable to INSERT and UPDATE
- Replies: 6
- Views: 2243
Unable to INSERT and UPDATE
DataStage Version: 5.2 I have a CSV file that contains data (Both old as well as new). I need to UPDATE the existing records and INSERT the NEW records. Below is my CSV Data ProdCode Name Type 90 Shirts U 91 Pants T 92 Shoes M 93 Tie K I am creating a HASH file from the DB2 table and making "Pr...