DSXchange: DataStage and IBM Websphere Data Integration Forum
View next topic
View previous topic
Add To Favorites
Author Message
poornima.chandramouli
Participant



Joined: 26 Dec 2007
Posts: 42
Location: India
Points: 412

Post Posted: Wed Jan 28, 2009 3:43 am Reply with quote    Back to top    

DataStage® Release: 7x
Job Type: Parallel
OS: Unix
Hi All,

In one of my job i'm joining 2 datasets by using a join stage based on 4 keys.

I'm clearing the partitioning in both the datasets while reading them & in the partitioning tab of the join stage i'm performing the Hash partioning on the join keys & enabled the perform sort (sorting the keys ascending).

Then i was writing the resultant in the target dataset.

But while running the job,i'm getting the warning like

JN_stage: When checking operator: User inserted sort "JN_Stage.LnkDS_Input_Sort" does not fulfill the sort requirements of the downstream operator "APT_JoinSubOperator in JN_Stage"

How to handle these kind of warnings.

Note : When I tried using the external Sort stage for sorting the records to JOIN stage & done a hash partition on the Sort Stage & used same partiton in the JOIN stage.I'm not getting any warnings.
But it was suggested by our client not to use external sort stage for sorting the records to the JOIN/Merge/CDC stage.


Thanks in advance

**Note: Subject changed to be more descriptive - Content Editor **

_________________
Regards
stefanfrost1



Group memberships:
Premium Members

Joined: 03 Sep 2007
Posts: 99
Location: Stockholm, Sweden
Points: 700

Post Posted: Wed Jan 28, 2009 5:32 am Reply with quote    Back to top    

First, I would recommend you to sort using the sort-stage since it enables alot of additional features, such as tuning memory etc.

Regarding your sort warning it could be that the 2 input links are different on the input tab. If not please check what datatypes are in your partitioning columns and if you have any warnings regarding implicit data type conversions.

_________________
-------------------------------------
http://it.toolbox.com/blogs/bi-aj
my blog on delivering business intelligence using agile principles
Rate this response:  
Not yet rated
ray.wurlod

Premium Poster
Participant

Group memberships:
Premium Members, Inner Circle, Australia Usergroup, Server to Parallel Transition Group

Joined: 23 Oct 2002
Posts: 51851
Location: Sydney, Australia
Points: 281523

Post Posted: Wed Jan 28, 2009 7:20 pm Reply with quote    Back to top    

Moderator: please move to parallel forum

Server jobs do not have a Join stage.

_________________
RXP Services Ltd
Melbourne | Canberra | Sydney | Hong Kong | Hobart | Brisbane
currently hiring: Sydney and Melbourne
Rate this response:  
Not yet rated
ece_balaji
Participant



Joined: 01 Oct 2008
Posts: 3

Points: 25

Post Posted: Thu Jul 30, 2009 11:30 am Reply with quote    Back to top    

This is the first time i came across this warning and its a join stage. The crazy thing here is, i did a hash patitioning and sorted on 2 keys and those 2 keys where varchar fields.
"When i made the partitioning keys as case sensitive the warning disappeared"

I made the partitioning keys as case sensitive because i am confident that my data is so.

I am not sure whether this is a bug, but try this if you get this warning. Before that make sure your requirement is to partition case sensitive data!!!
Rate this response:  
Not yet rated
Display posts from previous:       

Add To Favorites
View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Powered by phpBB © 2001, 2002 phpBB Group
Theme & Graphics by Daz :: Portal by Smartor
All times are GMT - 6 Hours