Search found 136 matches

by boxtoby
Mon Dec 22, 2014 3:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job takes 30 minutes to finish
Replies: 8
Views: 7800

Hi Eric,

"Manage Application Failover = Y" worked! Or at least the job didn't timeout.

Reconnect and disconnect are only available when the stage is used as a target.

Didn't try splitting the job, but an useful option.

Thanks,
Bob.
by boxtoby
Wed Dec 17, 2014 5:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job takes 30 minutes to finish
Replies: 8
Views: 7800

Hi All, Thank you for all your various contributions. I now have the same problem on a different job, except that error 3113 caused the job to abort. The job is very simple, read an oracle table and write the data in to an sql server table. No transformations, look ups, before or after sql anywhere....
by boxtoby
Wed Dec 10, 2014 10:09 am
Forum: General
Topic: trigger job only if file exists
Replies: 4
Views: 3997

The reply from the command probably needs trim(output, @FM, "A") in a User Variable stage.

Output from commands always has the @FM character appended to the end.

Hope that helps.

Bob.
by boxtoby
Mon Dec 01, 2014 11:32 am
Forum: General
Topic: Detect restart
Replies: 6
Views: 2481

Hi, Thanks for the suggestion of looking in the Sequence code in the job header. I found the routine "DSCheckPointExists" and created the routine below. However, the routine when called from the sequence always returns "START" whether running from normal or restart. As far as I c...
by boxtoby
Fri Nov 28, 2014 11:19 am
Forum: General
Topic: Detect restart
Replies: 6
Views: 2481

Detect restart

Hi,

Does anyone know how to detect if a sequence has been restarted?

I would like to redirect the processing in such an event.

Many thanks,
Bob.
by boxtoby
Fri Nov 28, 2014 9:56 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job takes 30 minutes to finish
Replies: 8
Views: 7800

Hi Eric, We are on DS 9.2, oracle 11g Connecting to oracle with the oracle connector stage There are no before or after sql statements We were watching the job for some time and were able to see that there were no oracle tasks running from the database consul very early on in the 30 minute window. T...
by boxtoby
Fri Nov 28, 2014 9:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job takes 30 minutes to finish
Replies: 8
Views: 7800

Job takes 30 minutes to finish

Hi Guys, I have had a couple of jobs which have finished processing, but won't finish. The jobs are quite simple, there are no look ups, joins, sorts or aggregations. The jobs write a large number of records (58m) to oracle and sql server tables and I can see that the records have been committed to ...
by boxtoby
Wed Nov 19, 2014 3:36 am
Forum: IBM QualityStage
Topic: Multiple variables not working
Replies: 14
Views: 11632

It might be that the comma is in the separator list (SEPLIST) or strip list (STRIPLIST) at the top of the pattern action. If it is you may need to remove it bit that might have an effect on other patterns. Also, are you sure that your new pattern is working at all? Could Orgname be populated from an...
by boxtoby
Thu Nov 06, 2014 7:27 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Operational metadata problem xmeta connection problem
Replies: 3
Views: 2683

Hi Ray,

I have been round that loop a few times but it didn't change anything, although it's the most obvious candidate.

Cheers,
Bob.
by boxtoby
Thu Nov 06, 2014 7:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Deadlock occurs while updating SQL Server table in datastage
Replies: 5
Views: 4767

Hello,

We had the same problem and found that partitioning on the key worked, might be worth checking the partitioning once more.

You could also try running the job in a single partition and see if that fixes it and what the response times are like.

Hope that helps!

Cheers,
Bob.
by boxtoby
Wed Nov 05, 2014 11:10 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Operational metadata problem xmeta connection problem
Replies: 3
Views: 2683

Operational metadata problem xmeta connection problem

Hi, I am hoping that someone can help me out here with an xmeta connection problem. When I run the script ./RunImportStart.sh I get the message: ./RunImportStart.sh Xmeta Process Meta Data XML Import Version 1.0 11/5/14 4:56:59 PM GMT INFO(500): Starting Xmeta process meta data import. Invalid usern...
by boxtoby
Fri Sep 12, 2014 2:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using Char(254) and field function
Replies: 3
Views: 2618

Hi Ray, I tried that, but the parallel transformer doesn't recognise @FM. We also have NLS turned on and the following dsenv settings: LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 NLS_LANG=AMERICAN_AMERICA.AL32UTF8 I have also viewed the data in hex and it appears exactly as I have described so I can't see t...
by boxtoby
Thu Sep 11, 2014 9:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Using Char(254) and field function
Replies: 3
Views: 2618

Using Char(254) and field function

I am getting some very strange behaviour when using the field function with char(254) as the separator and I wondered if anyone could shed some light on the problem. Here is the data: Col1 Debt Consolidation~~2~448 Char(254) is represented by the tilde character for clarity If I use the following ex...
by boxtoby
Wed Jul 23, 2014 4:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Use of new xml stage
Replies: 0
Views: 1164

Use of new xml stage

Hello, I would like to understand if there is any impact on job performance (run time) between using one very large xml stage and using a number of smaller xml stages and joining the data back together with a look up. The reason I ask is because I have a large number of multivalue fields which each ...
by boxtoby
Wed Jul 09, 2014 9:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Repeating groups in XML not being handled
Replies: 1
Views: 2106

Hi,

I have been able to establish that the xml and xsd is well formed and can be read by third party tools which can recognise the repeating elements.

So it would appear that there is something in the stage which needs to be set or unset to achieve the required result.


Many thanks,
Bob.