Search found 15603 matches

by ArndW
Tue Oct 04, 2005 2:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Abnormal termination of stage Jobname..stgname detected
Replies: 1
Views: 689

htrisakti3, this can be caused by several things. You will need to give us more information, it is like saying "My program has aborted, what has gone wrong?". Most frequent cause of this type of error message is doing incorrect programming in a transform stage which, although it compiles, causes a f...
by ArndW
Tue Oct 04, 2005 12:42 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File corruption in UV_SCHEMA file/table
Replies: 8
Views: 2337

Hello Ray & Kim, I've tried getting another valid UV_SCHEMA file/table into the same physical location - no avail, it also gives me no update privileges as either root/dsadmin. Normally I would bite the bullet and do a clean re-install, but this site is quite large and those 80+ projects have th...
by ArndW
Mon Oct 03, 2005 10:08 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File corruption in UV_SCHEMA file/table
Replies: 8
Views: 2337

File corruption in UV_SCHEMA file/table

In a system with over 80 active projects the UV_SCHEMA file has become corrupted. Unfortunately, even when logging in as root or dsadm, it can no longer be modifed (to replace the missing CATALOG entry). I have tried working with the builtin SQL statements in order to get access (both GRANT ALL PRIV...
by ArndW
Mon Oct 03, 2005 4:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job paramater - how to manage list
Replies: 4
Views: 1235

Since you are doing a string comparison the answer is not so difficult. Assuming your list is in the form {value},{value},... then the function INDEX(ParameterList,Link1.Column1:',',1) will return a 0 if the element is not in the list, or a position in the parameter list if it is found. Remember tha...
by ArndW
Mon Oct 03, 2005 1:25 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Calculating count ONLY on first occurence of each customer
Replies: 5
Views: 1083

Hello Gateleys,

the simplest and most efficient method would be to sort the incoming stream by Cust_ID and then to use a stage variable to store the last Cust_ID value and to do a comparison on this value with the current Cust_ID to see if this has changed in order to do your x5 computation.
by ArndW
Sun Oct 02, 2005 1:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: CPU usage question
Replies: 3
Views: 1018

Hello Affan, let us take a simple job example, reading from a source and with two transform stages before writing to some target. Normally this job will execute as one process under UNIX. On SMP architecture this will be processed on one CPU at a time, perhaps getting swapped out and back in onto an...
by ArndW
Sun Oct 02, 2005 4:05 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: about usage of Link partitioners
Replies: 6
Views: 1817

Ray, Just last week I came across a scenario where using the link partitioner made more sense than doing a multi-instance job. The data flow came from a database table and some complex transformations were done to the data before writing it to a staging hashed file. The throughput was (I'll use rows...
by ArndW
Sun Oct 02, 2005 3:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: iconv() in PX
Replies: 4
Views: 937

Your solution might be a good one for your job. In addition, once you have converted the DATE to an INT32 you can then use stage variables in a transform to get a MAX value across rows. But if your incoming data is already sorted in the group order you want it, then your solution with an aggregator ...
by ArndW
Sun Oct 02, 2005 3:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fatal Error: Added field has duplicate identifier()
Replies: 2
Views: 14762

Tasneem,

often the cause for this error is using column propagation and re-declaring an incoming coming. Do you have column propagation turned on in any of the output tabs going into this stage?
by ArndW
Sun Oct 02, 2005 3:50 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: updating hash file
Replies: 4
Views: 897

Vinodhj,

in DataStage jobs when you output to a hashed file it is always done as an 'update'.
by ArndW
Sat Oct 01, 2005 11:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Px DataSet information
Replies: 6
Views: 2052

At the moment this forum doesn't have have a "code" section, but PM me with your e-mail address and I'll fire off the program to you.
by ArndW
Sat Oct 01, 2005 11:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: iconv() in PX
Replies: 4
Views: 937

Normal PX jobs & transforms do not have the DS/Basic functions available to them.

You can use a BASIC transform stage in PX which gives you the ICONV/OCONV functionality, but it slows the jobs down considerably.
by ArndW
Tue Sep 27, 2005 1:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: filltering logic to generate the output file
Replies: 3
Views: 1551

There is no real limitation of how many output stages you might have; but for 60 potential output files this is a bit much. I would look into using the PX "fileset" - you can partition this so that you have 60 dataset files in the file set but in the job it just looks like you are writing one file.
by ArndW
Fri Sep 23, 2005 12:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: unable to extend index CUSTOMER_NN01 by 128 in tablespace
Replies: 5
Views: 2128

You can disable indices in a PX load job - but not for the reasons that there is not enough space left. Usually you disable constraints and indices during a bulk load to make it go quicker, then subsequently re-enable and re-build them. In your case that would abort as well. You need to talk to your...
by ArndW
Fri Sep 23, 2005 10:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSJOB getting details of Warnings / Fatals
Replies: 4
Views: 1433

The command line interface doesn't give you that option, but it is available in the routines, you can get the most recent run information from DSGetJobInfo() and use that time value to get the appropriate entries via DSGetLogSummary().