DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
techiexavier
Participant



Joined: 28 Feb 2012
Posts: 38
Location: Chennai
Points: 368

Post Posted: Wed Feb 13, 2019 8:34 pm Reply with quote    Back to top    

DataStage® Release: 11x
Job Type: Parallel
OS: Unix
Hi All,

Our parallel job design as below which runs in multiple nodes,

Oracle Connector --> Tr (4 Output links)--> Oracle Connector.

(4 Links out of Transformer and connected to one target Oracle connector).

Transformer and Target Oracle connector runs is sequential mode.
In the Oracle connector link ordering and record ordering for all records are defined.
Target Oracle connector performs delete for a row, update for a row, insert of all records and finally delete for a row in each of its input links.

Our job is failing in deadlock issue in some cases.

Can you please suggest whats the reason for the issue and solution to fix the same.

TIA.
techiexavier
Participant



Joined: 28 Feb 2012
Posts: 38
Location: Chennai
Points: 368

Post Posted: Wed Feb 13, 2019 8:41 pm Reply with quote    Back to top    

Point to add all the target activities are happening on the same table.
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 54462
Location: Sydney, Australia
Points: 295347

Post Posted: Wed Feb 13, 2019 9:40 pm Reply with quote    Back to top    

How are your transactions organized? In particular, how many rows per transaction for each of the CRUD operations? If the number of rows per transaction is anything other than 1, you're almost c ...

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
Rate this response:  
Not yet rated
techiexavier
Participant



Joined: 28 Feb 2012
Posts: 38
Location: Chennai
Points: 368

Post Posted: Wed Feb 13, 2019 9:59 pm Reply with quote    Back to top    

Transformations are like, the links which perform delete and update will have one record and other insert link will have more records.

So totally 3 links will have one record to target and rest one link has more records for insert.
Rate this response:  
Not yet rated
mouthou
Participant



Joined: 04 Jul 2004
Posts: 188

Points: 1826

Post Posted: Thu Feb 14, 2019 1:41 am Reply with quote    Back to top    

as the deadlock error comes out of Oracle, it is pretty obvious that there is same record going for more than one operation at the same time.

For debugging purpose, try removing the one link each time and run the job. you will get to know the link and what combination is still receiving/processing the same record which runs into deadlock. and you can change the design accordingly
Rate this response:  
Not yet rated
anudeepdasari001
Participant



Joined: 14 Dec 2015
Posts: 58
Location: Arizona
Points: 467

Post Posted: Thu Feb 14, 2019 3:33 am Reply with quote    Back to top    

Could you please tell me how huge is the data?

_________________
anudpETL
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours