Search found 53125 matches

by ray.wurlod
Tue Nov 18, 2003 3:06 pm
Forum: Data Quality Best Practices
Topic: 100 columns only need to scrub five
Replies: 1
Views: 2103

Create the following initial procedures. ADDKEY add a unique identifier to each row (can be a sequence) STORE95 put the 95 unneeded columns into a file, with the key STORE5 put the 5 needed columns into a file, with the key The STORE5 output file becomes the input file for scrubbing. Preserce the ke...
by ray.wurlod
Tue Nov 18, 2003 3:03 pm
Forum: Data Quality Best Practices
Topic: 100 columns only need to scrub five
Replies: 1
Views: 2103

100 columns only need to scrub five

Posted on behalf of Nag, who sent a private message. hello Ray, I have a rawdata and datafiles i need to do address scrubbing on five columns out of 100 columns in the raw data. What is the procedure should i follow and should i keep the raw data in the data/projects directory as i am new to this fo...
by ray.wurlod
Tue Nov 18, 2003 1:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Stage Variable manupilation query
Replies: 14
Views: 2475

You'll hit the Y10K problem in ISO 8601 dates before you'll need Decimal(20)! :lol:
by ray.wurlod
Tue Nov 18, 2003 1:25 am
Forum: Site/Forum
Topic: 'Mark all Topics Read' function
Replies: 3
Views: 2500

I disagree. There may be very many topics, say after you've returned from vacation. You want to mark them all read, but there may remain one or two that you'd still like to look at.
by ray.wurlod
Mon Nov 17, 2003 2:48 pm
Forum:
Topic: Parameter of my query for finding the filename of a HashFile
Replies: 6
Views: 2367

That raises the interesting question of how well parameterized names are propagated from DataStage to the MetaStage hub.
Certainly it's not well done to doc_tool.mdb.
Would anyone else like to share examples?
by ray.wurlod
Mon Nov 17, 2003 2:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using of '~' (Unix Home directory) instead of hardcoding
Replies: 18
Views: 4339

Don't forget that you can set run-time parameter defaults that are different to the design-time defaults, using Director (Job > Set Defaults).
by ray.wurlod
Mon Nov 17, 2003 2:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Stage Scheduling Issue
Replies: 6
Views: 1328

Not as much as bringing me in from Australia! However, this is a job that could be done "by remote control". If you were to create a specification of exactly what your control requirements were, a competent consultant could craft the code and ship it back to you, where you could inspect it, learn te...
by ray.wurlod
Mon Nov 17, 2003 2:16 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Column Sort
Replies: 4
Views: 1029

:shock: You get free time during the work week ?!!
by ray.wurlod
Mon Nov 17, 2003 2:07 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Merging variable number of input files
Replies: 4
Views: 956

One of the many things that Quality Stage (formerly known as INTEGRITY) can do is to "bucket" data into standard fields, and to standardize particular classes of words. For example, in addresses, some of the standard fields include house number, street name, street type (for example "street", "avenu...
by ray.wurlod
Sun Nov 16, 2003 1:00 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Using SAP functions in a job
Replies: 4
Views: 1004

There's nothing I'm aware of apart from editing the generated ABAP code. Have you sought advice from Ascential via your support provider? There may be some hidden trick (though I'm not aware of one, and the fact that the SAP Extract PACK is certified by SAP probably means that there's not much that ...
by ray.wurlod
Sat Nov 15, 2003 5:40 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Error 40908
Replies: 5
Views: 2259

This looks very much like you've discovered a problem in the job compiler in that either you've managed to create a component with a NULL identifier, or that the call to the process to update the RT_CONFIG143 file (in which run-time configuration is stored) has failed to set a value for the RecordID...
by ray.wurlod
Fri Nov 14, 2003 10:50 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Stage Scheduling Issue
Replies: 6
Views: 1328

In what country are you operating, Yi Ming?
by ray.wurlod
Fri Nov 14, 2003 10:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: LAPTOP Configuration to replicated ENV...AIX/DB2/DS/PX/QS/
Replies: 9
Views: 2062

:shock: I wonder who in Ascential gets to figure out the licensing issues!
by ray.wurlod
Fri Nov 14, 2003 10:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSD.DIROpen Error
Replies: 8
Views: 1702

The entire statement writes the contents of the variable "Record" into a file opened onto the variable VOC.FVAR (presumably the VOC file) with a key value of "&Folder&" without releasing the update lock. For this to make sense you would need to know the contents of the variable. I would suspect it's...
by ray.wurlod
Fri Nov 14, 2003 1:26 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Column Sort
Replies: 4
Views: 1029

Well, first (and most obvious) is the Sort stage.

As well as that, some partitioning/collecting operations will automatically perform a sort.