Search found 3045 matches

by vmcburney
Tue Oct 04, 2005 5:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: single source record need load two records in the target
Replies: 10
Views: 2990

If you are writing to a sequential output file you can funnel both your output links back together again. They should have the same column metadata.
by vmcburney
Tue Oct 04, 2005 5:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate ID generation in DS EE
Replies: 18
Views: 6832

If you are talking about retrieving these keys to satisfy foreign key relationships of subsequent dependent loads then you just do a fresh database lookup to retrieve the new keys. If you want to get just the new IDs back then do as Ray suggests and filter on the process id or date fields that shoul...
by vmcburney
Tue Oct 04, 2005 5:27 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Transformaer creating Multiple files
Replies: 3
Views: 1477

This usually happens when you set the "Output mode" to "Single row" on the Transformation Settings tab of the output stage. To quote the help file "Single row. Select to generate one XML document per input row."

If you switch to "Aggregate all rows" you get one XML document for all input rows.
by vmcburney
Mon Oct 03, 2005 6:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: "STRING" in a WHERE clause of FILTEER Stage
Replies: 1
Views: 873

Is your field trimmed? I would expect a char(10) to come through as "FLIGHT " or " FLIGHT" instead of "FLIGHT".
by vmcburney
Mon Oct 03, 2005 6:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: List jobs referencing table
Replies: 4
Views: 1074

If your development team has been disciplined and always loaded in your Teradata column definitions from the same saved table definition then you can find a list of jobs by running Usage Analysis on that table definition from the DataStage Manager Tools menu. However this is often not the case, or t...
by vmcburney
Mon Oct 03, 2005 6:11 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage Capacity planning ...HELP
Replies: 11
Views: 5900

I don't know about an Extended Edition of DataStage but the Enterprise Edition comes with parallel jobs and MetaStage.
by vmcburney
Sun Oct 02, 2005 5:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: dis-advantages of SCD`s
Replies: 5
Views: 1114

Taking an SCD type 2 table as an example there are three additional requirements over a normal table that take up resources. They store much more information, which impacts on (cheap) disk space, index size and performance. Every update to this table is two transactions, an insert of the new current...
by vmcburney
Fri Sep 30, 2005 6:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting extra Column from Database in the Transformer output
Replies: 3
Views: 988

A lookup is not that much of an overhead for a parallel job since it caches it in memory. Since the value does not change for each row it would be more efficient to pass it in as a job parameter or invocation id. The easiest way to retrieve a value from a database via a sequence job is the good old ...
by vmcburney
Thu Sep 29, 2005 9:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: compiling jobs in datastage 6x
Replies: 16
Views: 4355

You used to be able to get a download link to a version 6.0 multiple job compiler when you joined www.tools4datastage.com. I don't think you can get to that any more but there is a version floating around out there somewhere.
by vmcburney
Thu Sep 29, 2005 9:22 pm
Forum: Data Quality Best Practices
Topic: Before or after??
Replies: 9
Views: 11996

How many DWs can tell you the quality of the quantity?
by vmcburney
Thu Sep 29, 2005 6:30 pm
Forum: Data Integration
Topic: Database materialised views - are you using them?
Replies: 1
Views: 8088

Database materialised views - are you using them?

Are you using materialised views? What do you like about them? Our project is considering using DB2 materialised views for reports instead of queries against tables. One particular features looks very useful, the ability to freeze the view to a snapshot even when the underlying tables are being upda...
by vmcburney
Thu Sep 29, 2005 6:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage Capacity planning ...HELP
Replies: 11
Views: 5900

Just noticed that even though you posted in the server forum you already have an enterprise license. Because your DataStage and Oracle are using the same server you may need to scale your DataStage nodes down during the day so you don't pull resources away from online users and then ramp it up at ni...
by vmcburney
Thu Sep 29, 2005 6:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage Capacity planning ...HELP
Replies: 11
Views: 5900

1) You can do everything on the one DataStage server (and it will certainly save you a lot in licensing fees!). If you are concerned about scalability and whether your poor little server can handle the volume of four marts then consider upgrading to enterprise edition, increasing the CPUs and RAM or...
by vmcburney
Thu Sep 29, 2005 5:55 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Not able to see any parallel jobs in Job category
Replies: 4
Views: 1359

Have a look at the FAQ on DataStage reporting to see what options you have:
http://www.dsxchange.com/viewtopic.php?t=93565
by vmcburney
Thu Sep 29, 2005 5:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: surrogate ID generation in DS EE
Replies: 18
Views: 6832

We use DB2 sequences and not DB2 identity columns. I am not sure which is better. If I had a choice I would go for ETL generated keys every time. We have issues with DB2 sequences, we have to fudge the insert SQL to make it retrieve NEXTVAL from the sequence to generate an id, it can be difficult to...