Search found 15603 matches

by ArndW
Tue Aug 28, 2007 8:44 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage routine for field validation.
Replies: 6
Views: 2468

Server routines can only be called in PX from BASIC transform stages, and there is a performance hit when you do that and is generally not recomended.

The routine CheckLine(Line,Delimiter,CheckCount) is

Code: Select all

IF DCOUNT(Line,Delimiter)=CheckCount THEN Ans = 'Y' ELSE Ans = 'N'
by ArndW
Tue Aug 28, 2007 8:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: ds.tools
Replies: 5
Views: 1755

The "DS.TOOLS" entry in the VOC is a menu item that is installed in each DataStage project. If it is missing it is probably a sign that you have bigger problems. It is only installed in the project directories and not the master VOC; perhaps that is why you might not be able to find it. Also, even t...
by ArndW
Tue Aug 28, 2007 7:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting job if too few rows are processed
Replies: 9
Views: 1915

Yes, setting the error code to 1 will do that, but won't put a message in the log stating why, just that the after-job triggered an abort.
by ArndW
Tue Aug 28, 2007 7:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: datastage routine for field validation.
Replies: 6
Views: 2468

In PX you would need to code this as a C++ routine. Since you can do the computation in a single line in a transform stage it would be more efficient and less work. Also, I think the DCOUNT() routine is a better one for you to use, i.e. a string of "Hello,World,!" would return 3, which is the number...
by ArndW
Tue Aug 28, 2007 7:09 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: flat file with early terminators
Replies: 4
Views: 1015

Read the as a single very big column to a transform stage.
Do a DCOUNT(In.BigCol,{YourColumnDelimiterCharacter}) to see if the number of columns is correct.
Using stage variables, pass the record on if the count is correct, otherwise store the string and prepend it to the next row's data.
by ArndW
Tue Aug 28, 2007 3:45 pm
Forum: General
Topic: Difference between DSEngine and PX Engine
Replies: 2
Views: 1843

Both DS and PX are based on different technologies. The DS Engine is an actual engine, based on the UniVerse product now owned by IBM. The PX Engine is different, as it isn't a server/engine as such but a collection of programs and files that are used to generate and run PX jobs. PX has been integra...
by ArndW
Tue Aug 28, 2007 3:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: unable to view output data(dataset)coming from compare stage
Replies: 1
Views: 721

Use the Dataset tool option in your manager/director and view the schema of your dataset - it most likely was written with char() and your job metadata is integer. Correct one or the other.
by ArndW
Tue Aug 28, 2007 3:38 pm
Forum: General
Topic: Job Hanging.
Replies: 17
Views: 5002

Abu - that sounds a lot like hearsay. I've implemented jobs using IPC with huge numbers of records without problems. The IPC stage can improve performance on jobs that don't have inteprocess buffering enabled, if that is turned on then IPC stages make no difference at all.
Back the "Hang" question...
by ArndW
Tue Aug 28, 2007 3:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Data Extract fails with Long column in SELECT clause
Replies: 2
Views: 894

I dind't think that LONG was supported, but am not sure. How long is your definition?
by ArndW
Tue Aug 28, 2007 3:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aborting job if too few rows are processed
Replies: 9
Views: 1915

You could write a short after-job routine, in which you get the row count from your database link and if the nubmer is below your threshold issue a call to DSLogFatal() to force the job to abort.
by ArndW
Tue Aug 28, 2007 3:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fixed Column Width in PX Sequential File
Replies: 3
Views: 850

What are your first two column metadata definitions in your job? When you do a 'display data' do you only get the 1st column contents (correctly)? What is displayed for the 2nd column?
by ArndW
Tue Aug 28, 2007 3:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job is being access from another user
Replies: 9
Views: 4502

You need to be the Administrator to UNLOCK jobs. In addition, you cannot unlock just an INODE, you also need to specify the DEVICE. Furthermore, you should unlock the user, not the file.
by ArndW
Tue Aug 28, 2007 12:28 am
Forum: General
Topic: Job Hanging.
Replies: 17
Views: 5002

I doubt there is a bug - this is base functionality used successfully in hundreds of sites.
Try pointing your output Seq file to '/dev/null'
by ArndW
Tue Aug 28, 2007 12:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Unable to load subroutine on host (30105
Replies: 19
Views: 13298

You must do a "LOGTO {YourProjectName}", the DS.CHECKER verb is not present in the master VOC

I just realized you have the verb, but not the object code for it. You have a bad project, just as Ray has stated.
by ArndW
Mon Aug 27, 2007 11:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting an Error: regarding Input Redirection
Replies: 11
Views: 9631

I really should have been paying attention - this is a Version 8 question and I think it likely that you are going to have to get IBM support involved as it does look more like a bug than a design issue.