Search found 3045 matches

by vmcburney
Mon Sep 05, 2005 3:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Joc trmplates
Replies: 7
Views: 2398

I agree, templates feels like a piece of functionality that is only partially there. On large projects it is easier to use then copy job but requires some organisation to set up. The thing about copy job is knowing which job to copy, having that job in your project and then having to remove all the ...
by vmcburney
Sun Sep 04, 2005 7:07 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Error Messages in PX
Replies: 2
Views: 1211

Everyone who starts developing in parallel jobs gets a truck load of warning messages, especially when you throw sequential files and transformers into the mix. It's just a matter of experience, training, learning and experimentation that makes it easier to avoid them.
by vmcburney
Fri Sep 02, 2005 12:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning - "Sequential file cannot preserve partion"
Replies: 9
Views: 4727

Of course T42 once made the observation that he could make all warnings go away through good development! Have you tried putting a copy stage between the transformer and the sequential file and then playing with the partition settings of that copy stage?
by vmcburney
Fri Sep 02, 2005 12:16 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to compare previous value of a record to next record
Replies: 3
Views: 1067

You have to keep in mind that stage variables are executed in the order they appear. A stage variable that does the comparison should appear before a stage variable that holds the value from the previous row. svNewValue: input.custid svCustidIsChanged: svNewValue <> svOldValue svOldValue: input.cust...
by vmcburney
Thu Sep 01, 2005 11:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning - "Sequential file cannot preserve partion"
Replies: 9
Views: 4727

Unfortunately when Ascential released the message handler functionality they did not provide any guidance as to when or why it should be used. Here is how I use it: No message handlers in development, unit testing, functional testing or user acceptance testing. Testers get to see the jobs run warts ...
by vmcburney
Thu Sep 01, 2005 5:57 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Warning - "Sequential file cannot preserve partion"
Replies: 9
Views: 4727

There is a message in the FAQ forum for setting up a parallel job message handler. Because parallel jobs are chronic whingers it is almost mandatory to add a message handler to any production environment (recommend not adding one to development) to remove trivial warnings so that the job finishes wi...
by vmcburney
Thu Sep 01, 2005 12:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Importing parallel shared container
Replies: 13
Views: 3933

Have you tried saving it to a parallel job and exporting and importing it that way? I wonder whether it is failing to import because it is a shared container or because it contains a stage type that your target project cannot handle.
by vmcburney
Wed Aug 31, 2005 11:51 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Square root of a negative
Replies: 7
Views: 3029

I was told by Ascential support that it was a known defect in the XML Input stage on Solaris and we could just ignore it. Posted this same message some months back when someone else asked the same question. Doesn't cause any harm to your data, it's just a nuisance that may result in your support sta...
by vmcburney
Wed Aug 31, 2005 6:23 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Clearcase UCM and DataStage
Replies: 5
Views: 1277

What exactly are you merging? If you take the example where you have an entire project dsx checked in and you want to merge in a single job dsx to overwrite the existing. The merge should work if it can correctly locate the start and end job statements for that job. The danger is if the merge lost t...
by vmcburney
Wed Aug 31, 2005 5:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Is CVS compatible with DS Server?
Replies: 5
Views: 1670

Record keeping and collaboration for DataStage projects is part of the next release, DataStage Hawk, which goes into beta testing soon. DataStage has previously not been very strong on team collaboration, apart from a robust client/server design, but the next release promises to improve things.
by vmcburney
Fri Aug 26, 2005 4:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture Stage Problem
Replies: 2
Views: 1232

CDC is quite straight forward, your delta data is the "After" view and your dimension is the "Before" view. CDC will output your rows with the change data code that will indicate which rows are modified and which are new. Make sure you drop off unchanged rows and delete rows and you are good to go. ...
by vmcburney
Fri Aug 26, 2005 4:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Insert/Update Job Design: Comments?
Replies: 10
Views: 4127

I always felt you were better off doing surrogate key lookup first and then doing change data capture on the rows that already exist and sending the new rows directly down an insert path. A surrogate key lookup only retrieves a couple columns from the database while CDC returns every column. So look...
by vmcburney
Fri Aug 26, 2005 4:40 pm
Forum: Information Analyzer (formerly ProfileStage)
Topic: ProfileStage polished?
Replies: 3
Views: 2574

I've always felt ProfileStage and QualityStage are the two GUIs that were the most difficult to use. Which is probably why they both get completely rewritten in the next releases. ProfileStage is a good profiling tool for a project team due to the controls over the stages in profiling. If you are af...
by vmcburney
Thu Aug 25, 2005 6:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: regarding Dataset
Replies: 8
Views: 2208

I think that's the way view data works. When I view data on a database table with no rows I also get an error with the option to view more details, the attached log shows a row limiter hit error. Should be okay when you actually run the job.
by vmcburney
Thu Aug 25, 2005 6:45 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: netstat -a |grep dsrpc
Replies: 4
Views: 3204

Maybe it's trying to create the dstmp.050825.093754A as a log file but cannot get write access to the engine directory. Assume you are logged in as the DataStage admin user (eg. dsadm), have you tried creating the dstmp file in that location manually?