Search found 7201 matches

by admin
Fri Mar 29, 2002 9:51 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: Routines versus Transforms
Replies: 12
Views: 5549

If you create a transform that calls a routine there is no difference. A transform is simply code that is inserted in-line to the generated program. If you can code your logic in a single line (without calling a routine) it will execute more efficiently as a transform. But, since it is limited to a ...
by admin
Fri Mar 29, 2002 9:44 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: Routines versus Transforms
Replies: 12
Views: 5549

I agree that if all that your Transform does is call your routines, then there is going to be no speed difference. It was only on Wednesday I was listening to a UK Ascential Software person saying to avoid Routines in favour of Transforms (that is with the code in the Transform). Of course this is n...
by admin
Fri Mar 29, 2002 9:40 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: How to send an e-mail / mail message through DataStage
Replies: 12
Views: 1909

Is that true your mail system and DS server should on same box? how do they communicate each other. I tried before it did not work for my sutiation: DS server, OS win2000, box1; mail server, MS exchange system, box2; DS client, OSwin2000, my desktop. Thanks! -----Original Message----- From: Raymond ...
by admin
Fri Mar 29, 2002 8:48 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: Routines versus Transforms
Replies: 12
Views: 5549

Routines versus Transforms

I dont really want to start any kind of holy war of Routines versus Transforms, but the note below reminded me of something Ive been wondering about, off and on, for a long time. When I first started working with DataStage (back when the documentation still said VMark, if that means anything to anyo...
by admin
Fri Mar 29, 2002 8:07 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: Performance Problem
Replies: 0
Views: 477

Performance Problem

Hello, I have a datastage job which does a full table scan on a staging area table with 125 columns. There are about 15 hash lookups in that job. The maximum amount of rows in a hash being 600000 for one. I am getting a performance of 130 rows per second. I have set my array size to 10000 and may tr...
by admin
Fri Mar 29, 2002 7:20 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: MERGE stage
Replies: 2
Views: 2098

David, I totally agree with you about using hash file look up. I was trying send out my question below to everyone yesterday, somehow, it didnt sent out. My question is related to Hash, maybe you can help me a little bit. ****************************** I was trying to take advantage of using merge s...
by admin
Fri Mar 29, 2002 10:46 am
Forum: Archive of DataStage Users@Oliver.com
Topic: cleaning of data
Replies: 2
Views: 419

You need to bear in mind that any routine you use will slow down the job as it will be called each time a row is passed through a job. If you can get away with using a Transform(s), however this may mean having several different ones to suit your different dates, this is quicker when running the job...
by admin
Fri Mar 29, 2002 12:36 am
Forum: Archive of DataStage Users@Oliver.com
Topic: how to determine if SQLServer ODBC native drivers are used
Replies: 2
Views: 435

PHB??? It this some Aussie term that I presume is not very complementary? -----Original Message----- From: Raymond Wurlod [mailto:wurlodr@au1.ibm.com] Sent: Thursday, March 28, 2002 4:30 PM To: datastage-users@oliver.com Subject: Re: how to determine if SQLServer ODBC native drivers are used I would...
by admin
Fri Mar 29, 2002 12:29 am
Forum: Archive of DataStage Users@Oliver.com
Topic: how to determine if SQLServer ODBC native drivers are used
Replies: 2
Views: 435

I would strongly suggest that you ask the DBA. Clearly, on UNIX, you are not using Microsoft-supplied ODBC drivers. This is for the simple reason that Microsoft do not supply drivers for UNIX platforms. If your DBA cannot accept this, then suggest the job acronym be changed to PHB. Other than that, ...
by admin
Fri Mar 29, 2002 12:13 am
Forum: Archive of DataStage Users@Oliver.com
Topic: how to determine if SQLServer ODBC native drivers are used
Replies: 2
Views: 435

how to determine if SQLServer ODBC native drivers are used

Were running DataStage 4.1 on AIX, a client of WIN2000, with the normal target being Oracle 8.1.6. If we design a job with an ODBC source stage, and the ODBC connection is to a SQLServer2000 database across the network, the SQLServer DBA wants to be sure we use the SQLServer ODBC native drivers. How...
by admin
Thu Mar 28, 2002 8:55 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: Job Parameters
Replies: 4
Views: 866

I had a similar situation: passing down parameter based on an input record. For example, the input record value is a system date,(or whatever date you assigned) and you want to look up a table of last week run records with #START-DATE# AND #END-DATE#. First,you figure out firstday, lastday in DS env...
by admin
Thu Mar 28, 2002 6:09 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: cleaning of data
Replies: 2
Views: 419

You can write a datastage routine in Datastage Manager and use it in the transformation. This way all your validation is done in routine and can be called from many jobs if needed. Palanisamy Sakthivel Participant Datastage Newgroup -----Original Message----- From: Castelein, Maaike [mailto:maaike.c...
by admin
Thu Mar 28, 2002 3:42 pm
Forum: Archive of DataStage Users@Oliver.com
Topic: cleaning of data
Replies: 2
Views: 419

cleaning of data

Hi, Not living in a perfect world I have problems with sequential input files containing bad data : for example dates in different formats (I want to reformat all dates into one format) or just plain wrong (2002-02-31). Does anyone have practical information on how to clean and validate your data in...
by admin
Thu Mar 28, 2002 10:48 am
Forum: Archive of DataStage Users@Oliver.com
Topic: Upgrade DS to 5.1 - Solaris
Replies: 2
Views: 430

make sure you make a copy of your dsenv file in the DataStage server engine directory, before upgrading. I have seen it overwritten before. ----- Original Message ----- From: "Rui Soares" To: "Datastage-Users (E-mail)" Sent: Wednesday, March 27, 2002 10:45 PM Subject: Upgrade DS to 5.1 - Solaris > >...
by admin
Thu Mar 28, 2002 10:43 am
Forum: Archive of DataStage Users@Oliver.com
Topic: Data Stage related issues
Replies: 2
Views: 498

With reference to number 2 - DataStage buffers the writes to a hashed file, so even if the monitor showed all records as being processed DataStage might still be writing to disk. You should only see this with a large number of records. ----- Original Message ----- From: "Sameh Bishara" To: Sent: Wed...