Search found 251 matches

by rleishman
Tue Nov 16, 2010 10:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle OCI Stage vs Oracle Connector
Replies: 2
Views: 5926

The OCI Stage appears in the palette for Datastage Server jobs, not for Parallel jobs. This stage cannot be parallelised by DataStage. So far as I can determine, its functionality is identical to the Dynamic RDBMS Stage in Parallel Jobs (when attached to an Oracle database). Like the OCI stage, the ...
by rleishman
Wed Mar 10, 2010 6:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture Stage - How to avoid Scratch space usage
Replies: 3
Views: 3744

Both suggestions work perfectly. Thanks guys.
by rleishman
Thu Mar 04, 2010 11:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Change Capture Stage - How to avoid Scratch space usage
Replies: 3
Views: 3744

Change Capture Stage - How to avoid Scratch space usage

I have a job that uses the Change Capture Stage to identify differences between two similar data sets. Both data sets are pre-sorted and partitioned on the change-key. Each data set has 1M rows. I want it to stream the output straight through, but it is writing the entire thing to scratch disk befor...
by rleishman
Thu Mar 05, 2009 9:44 pm
Forum: General
Topic: Unusually slow DataStage 8.0 engine
Replies: 1
Views: 2223

Unusually slow DataStage 8.0 engine

I'm working for a client where DS 8.0 is installed and maintained by a centralised group (not my team); they give us a project to develop and test our jobs. The jobs on this environment are just plain SLOW. For example, a Server job that reads and writes a single row from one sequential file to anot...
by rleishman
Thu Jan 22, 2009 4:13 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Link from an Oracle Enterprise stage - DELETE action
Replies: 2
Views: 2701

I'll take that overwhelming round of silence as a "dunno". Either that or I didn't express the problem clearly. Anyway, as a heads-up to anyone who searches on this in the future, I'll give an update on how we proceeded. Rather than use DS to fetch the rows to delete in an Enterprise Stage...
by rleishman
Mon Jan 19, 2009 10:12 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reject Link from an Oracle Enterprise stage - DELETE action
Replies: 2
Views: 2701

Reject Link from an Oracle Enterprise stage - DELETE action

We have an archiving process that deletes rows from a top level table, which then uses DELETE CASCADE RI constraints to remove rows from subordinate tables - potentially many levels deep. In some cases, a low level table may have two parent foreign keys - ie. two different paths by which it may be a...
by rleishman
Sun Nov 09, 2008 7:48 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: User defined SQL in Oracle Stage
Replies: 9
Views: 3870

Beware of to_char(sysdate,'D')=1

Depending on your NLS settings, the numbering of days can vary. I once had this problem (and I think it was with DS) because DS set the NLS init params differently.

Try using to_char(sysdate, 'DY') = 'MON'
by rleishman
Mon Jul 07, 2008 8:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle hints issue?
Replies: 9
Views: 4294

... the explain plan is the same. I just restarted the DS job and checked to confirm that. How did you confirm it? Did you perform a SQL Trace? Or check V$SQL_PLAN. If you used a GUI, then it is possible that it re-planned the SQL rather than showing the actual execution plan. If the plan is the sa...
by rleishman
Mon Jul 07, 2008 8:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: passing User defined Env variable in dsjob -run
Replies: 6
Views: 3006

Don't have DS at the moment, but from memory, dont you have to specify -local and execute from the PROJECT directory to retain $ENV values from the current environment?
by rleishman
Thu Jun 19, 2008 5:55 pm
Forum: General
Topic: Is Datastage compliant with Oracle RAC?
Replies: 6
Views: 4332

OK. I think I have enough information for my purposes. It seems likely that Craig and I were both right. Why is that not surprising with Oracle? In a RAC, I believe that the NORMAL operating procedure is for applications to nominate a single database instance in the RAC that it will use. This is don...
by rleishman
Thu Jun 19, 2008 5:12 pm
Forum: General
Topic: Is Datastage compliant with Oracle RAC?
Replies: 6
Views: 4332

Thanks Craig, that makes sense. My DBA hasn't worked with RAC before - nor have I. I was making some round assumptions about how it would work based on a rudimentary knowledge of the architecture. I'm not actually looking to do this - yet. I just want to be able to document a plausible upgrade path ...
by rleishman
Thu Jun 19, 2008 12:13 am
Forum: General
Topic: Is Datastage compliant with Oracle RAC?
Replies: 6
Views: 4332

Is Datastage compliant with Oracle RAC?

I thought this was going to be an easily confirmed thing, but I can't find anything on ibm.com, Google, or - surprise surprise - here. I have used DS Enterprise in its simplest form - parallel processing on a single box, writing to a single Oracle instance. I understand that it can be configured to ...
by rleishman
Thu Jan 10, 2008 1:16 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NextSurrogateKey() in a stage variable
Replies: 6
Views: 4698

I believe you can only set NextSurrogateKey() to output link columns - kind of limits it's usefulness.
by rleishman
Thu Jan 10, 2008 12:43 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: What is the use of pivot stage?
Replies: 3
Views: 1975

To convert 1 input row into 2 or more output rows. For example, you could pivot a row that contained:

Code: Select all

Department, Year, Sales_Jan, Sales_Feb, Sales_Mar, ...
into

Code: Select all

Department, Year, Month, Sales
In this example the output would contain 12 rows for every input row.
by rleishman
Thu Dec 20, 2007 1:37 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hashed File record Clearance
Replies: 4
Views: 2408

In the INPUT tab of the hashed file, check the "Clear file before writing" box.