upsert is taking long time

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
srinivas.g
Participant
Posts: 251
Joined: Mon Jun 09, 2008 5:52 am

upsert is taking long time

Post by srinivas.g »

In my target i used upsert option. for 50000 records it tooks 10 minutes.
but the same job i designed in server and it took 2 minutes.
The design of the job is :

oracle --> transformer ..> oracle

Please suggest why parallel is taking more time
Srinu Gadipudi
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Probably something to do with the multiple nodes contending with each other. Does your partitioning guarantee that each key value can occur on only one node?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Sampath
Participant
Posts: 21
Joined: Tue Apr 05, 2005 2:03 am

Post by Sampath »

Use loading as sequential method
Regards,
Sampath
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

What's the point of buying a parallel execution engine then?!!!!
Sampath wrote:Use loading as sequential method
Extremely poor advice, in my opinion.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
srinivas.g
Participant
Posts: 251
Joined: Mon Jun 09, 2008 5:52 am

Post by srinivas.g »

I used hash partiotiong this time job aborted.

Operator terminated abnormally: received signal SIGSEGV
Srinu Gadipudi
Post Reply