Search found 3045 matches

by vmcburney
Thu Sep 08, 2005 10:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: function that returns the datatype
Replies: 2
Views: 1018

At this point in time you need to define your column names and data types when you develop the job. If your source is a database table then the expectation is the metadata on the table does not change, if it does change the DataStage job needs to be changed. If your source is a text file or your dat...
by vmcburney
Thu Sep 08, 2005 5:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to copy contents in Data Browser
Replies: 2
Views: 974

Backwards functionality! There have been a couple handy features in 7.0 that are no longer in 7.5. One of the reasons why the Hawk beta testing will be useful.
by vmcburney
Thu Sep 08, 2005 5:22 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Pattern Matching in DS PX
Replies: 3
Views: 1140

There is the Index function which finds the starting character position of a substring. It can be used in a parallel transformer. Not sure if it will work in a filter stage. Constraint: Index(input.mycol, "MI") > 0
by vmcburney
Thu Sep 08, 2005 4:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Reject
Replies: 3
Views: 868

I would filter them out in the initial SQL select if you don't want them involved in your job in any way, I would filter them out in the job via a constraint if you don't want to process them but you want to write them to a reject file for data quality investigation.
by vmcburney
Thu Sep 08, 2005 3:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate Key lookup
Replies: 6
Views: 1924

There is nothing wrong with the surrogate key stage. Whatever method you use if you are going to generate keys within the job you need to provide the job with the last high value used via a job parameter. Then you can use the surrogate key stage which is the specialised stage for this task and will ...
by vmcburney
Thu Sep 08, 2005 12:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Doing a lookup with a range rather than equals
Replies: 5
Views: 1828

Is any one using a good range lookup custom stage? There was talk of one being available via Ascential services. Currently range lookups are messy in parallel jobs and it would be good to have a more efficient option.
by vmcburney
Wed Sep 07, 2005 11:50 pm
Forum: Data Quality Best Practices
Topic: Company acquisitions to shake up the market
Replies: 0
Views: 3055

Company acquisitions to shake up the market

A direct mailing company, Pitney Bowes, has bought First Logic! First Logic is one of the biggest DQ vendors in the US and has OEM agreements with Business Objects and Informatica (and Ab Initio?). Informatica may have seen this coming as they signed a new OEM with Trillium. Pitney Bowes also bought...
by vmcburney
Wed Sep 07, 2005 7:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Referencing Environment Variables in Routine
Replies: 5
Views: 1470

In parallel jobs there is a GetEnvironment function but I don't know of an equivelent one in BASIC. You could you DSExecute to run an echo command. It's not a very good programming practice as it stops your routine from operating as a black box. It can lead to misunderstandings from support in produ...
by vmcburney
Wed Sep 07, 2005 5:49 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: $Projdef
Replies: 5
Views: 6440

There is a FAQ on this topic. You can read it at:
http://www.dsxchange.com/viewtopic.php?t=92038

Or you can view the modifiable version at:
http://wiki.ittoolbox.com/index.php/HOW ... _variables
by vmcburney
Wed Sep 07, 2005 5:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Doing a lookup with a range rather than equals
Replies: 5
Views: 1828

Why don't you round the value off and match it exactly? In a transformer prior to the lookup create a stage variable that rounds to the nearest digit. If the resulting value is greater then the original value then reduce it by 0.5. This gives you rounding to the nearest 0.5. If this value is > 0 and...
by vmcburney
Tue Sep 06, 2005 6:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: use of column import/transformer
Replies: 3
Views: 1073

Agree, since you already plan to have a transformer in your job I would do it all in that transformer. The FIELD command should be able to pick the columns out of your varchars quite easily and you may need stage variables or you may be able to do it straight in the derivation fields. The FIELD func...
by vmcburney
Tue Sep 06, 2005 5:54 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Find usage of particular flat files throughout DS jobs
Replies: 4
Views: 1355

Run Export project, check the "Export as XML document" tab and then go to the XML tab. You will see a "Style sheet" option. Make sure this is checked and set to the default DSReport-Waterfall.xsl in your DataStage program directory. Run this export. Open up the XML document in a web browser, you wil...
by vmcburney
Tue Sep 06, 2005 5:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: regarding Date conversion
Replies: 17
Views: 6101

I keep a test job around that has every data type as input and output. I use it to test parallel transformation and modify functions such as these. It lets me output the final result and interim values such as the value produced by DecimaltoString. You may need to add formatting to your DecimaltoStr...
by vmcburney
Mon Sep 05, 2005 8:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joc trmplates
Replies: 7
Views: 2398

I didn't say there would be a demise of server jobs, in fact I think they will be supported for years to come. I said there would be no new functionality in server jobs. There will be bug fixes in server jobs because there are a lot of people using them. Server jobs may also benefit from some enhanc...
by vmcburney
Mon Sep 05, 2005 8:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joc trmplates
Replies: 7
Views: 2398

I wouldn't expect any new functionality for server jobs from here on. Anything in the new release such as wizards, templates and a scd specialised stage will be developed for parallel jobs.