Search found 3045 matches

by vmcburney
Thu Dec 01, 2005 4:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ascential Certification
Replies: 9
Views: 4263

Looks like a wide exam scope. I find myself loathing the idea of memorising all the EE environment variables! Hopefully they will just test on the commonly used ones such as config file, combine operators and tracing. Some notable exclusions are job control BASIC, version control tool and the XML in...
by vmcburney
Wed Nov 30, 2005 7:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: accesing data without importing table definition in DS
Replies: 10
Views: 2776

Some database engines optimise queries that are used more then once and you can find it runs a lot faster with repeated use.
by vmcburney
Wed Nov 30, 2005 4:58 pm
Forum: IBM<sup>®</sup> DataStage TX
Topic: Need for DS TX
Replies: 10
Views: 6354

When Ascential bought Mercator and turned it into TX it came with a very large number of adaptors and connectors including some EAI queues that DataStage did not have. Couldn't tell you the exact list, it used to be listed on the Ascential web site but in recent times they have made this type of inf...
by vmcburney
Wed Nov 30, 2005 4:46 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: accesing data without importing table definition in DS
Replies: 10
Views: 2776

To expand on Craig's answer, the table definitions are really just a design tool, when the job is running it only looks at the local job column definitions. You need to compare the cost on the user defined SQL of adding the third table, whether database optimisation will improve this SQL, or whether...
by vmcburney
Wed Nov 30, 2005 4:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Copying [EnvVarValues] of DSParams Unsuccesful
Replies: 2
Views: 1070

Well done. It is a tricky little business copying sections of DSParams. Do a search check on a parameter name and make sure it is not duplicated. If you get the copy wrong the DS Administrator tool can end up duplicating a section and it becomes difficult to make changes.
by vmcburney
Wed Nov 30, 2005 4:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS EE and Upgrade Help
Replies: 1
Views: 677

The install process should stop and start the server for you and handle any shared memory. It should retain your existing config files but take backups just in case. You should also backup your dsenv file as you may lose your Oracle settings and need to reapply them.
by vmcburney
Wed Nov 30, 2005 4:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Infinite looping of a Datastage Sequence (using waitforfile)
Replies: 2
Views: 3407

Sequence job: - start loop with a very high number of loops defined using a job parameter in case you need to run the sequence with a limited number of loops. - a set variables stage that calls a routine that determines how many seconds until 10PM, two outputs with a different trigger on each, jump ...
by vmcburney
Wed Nov 30, 2005 4:06 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: getting identity columns
Replies: 1
Views: 848

Your target table has the surrogate key and the fields that comprise the natural key, even if they are not defined as key fields. You update your mapping table by retrieving the surrogate and natural key fields from your target table using some type of incremental load filter such as processing id o...
by vmcburney
Wed Nov 30, 2005 3:58 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage Server Jobs Created from Mimix Replicate1
Replies: 6
Views: 2220

It's a plain text file.

So how are you passing replicated data to your DataStage jobs? Are you using the SOA edition and building jobs as services? People might remember Mimix Replicate under the old name Omni Replicate. Would be interested to know how it interacts with DataStage.
by vmcburney
Wed Nov 30, 2005 2:29 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need Details
Replies: 5
Views: 1660

According to a thread at developernet Ray saw a demo at IILive. I've heard that certification for DataStage EE is ready and we should see something at the start of next year. I don't think there will ever be a version for server edition.
by vmcburney
Tue Nov 29, 2005 10:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DS PX - cluster
Replies: 4
Views: 1773

Okay, no replies so I'll take a shot. DataStage has a definition of the cluster within the configuration file of the main server. Some server software needs to be installed on each machine in the cluster but I'm not sure how much. Yes you do need rsh communication between the nodes though I believe ...
by vmcburney
Tue Nov 29, 2005 10:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Adding description to jobs
Replies: 8
Views: 2767

Part of your problem when adding descriptions may be understanding what the job is really doing. My vote for the fastest method for screening the job and adding a description is to generate full HTML documentation using the dssaveasbitmap script posted on devnet. Allocate them to whoever is doing de...
by vmcburney
Tue Nov 29, 2005 10:36 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Can I output to a txt file from batch job???
Replies: 2
Views: 750

BASIC programming in DataStage can be easy. Just refer to the DataStage BASIC Guide or the basic chapter in the Server Job Developers Guide and search for specific commands on this forum for examples.
by vmcburney
Tue Nov 29, 2005 5:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Compare 76 inbound fields with 76 fields of table
Replies: 7
Views: 2997

If the table you are comparing is also the table you are loading here is a good design: cleanse, compare then load. Clean your data in a transformer, compare it in another transformer and then load the inserts and updates. You want cleansed data in your DB2 table. You don't want to have to guess whe...
by vmcburney
Tue Nov 29, 2005 4:47 pm
Forum: IBM QualityStage
Topic: QS Deduplication Job taking 2jrs for 34000 records
Replies: 13
Views: 7405

Your QualityStage text log file will tell you a lot, it has an entry for each step with a timestamp so you can roughly tell how long each step is taking (I hope!). Strange that it is slower in prod, are any traces turned on?