User inserted sort does not fulfill the sort requirements
Posted: Wed Jan 28, 2009 3:43 am
Hi All,
In one of my job i'm joining 2 datasets by using a join stage based on 4 keys.
I'm clearing the partitioning in both the datasets while reading them & in the partitioning tab of the join stage i'm performing the Hash partioning on the join keys & enabled the perform sort (sorting the keys ascending).
Then i was writing the resultant in the target dataset.
But while running the job,i'm getting the warning like
JN_stage: When checking operator: User inserted sort "JN_Stage.LnkDS_Input_Sort" does not fulfill the sort requirements of the downstream operator "APT_JoinSubOperator in JN_Stage"
How to handle these kind of warnings.
Note : When I tried using the external Sort stage for sorting the records to JOIN stage & done a hash partition on the Sort Stage & used same partiton in the JOIN stage.I'm not getting any warnings.
But it was suggested by our client not to use external sort stage for sorting the records to the JOIN/Merge/CDC stage.
Thanks in advance
**Note: Subject changed to be more descriptive - Content Editor **
In one of my job i'm joining 2 datasets by using a join stage based on 4 keys.
I'm clearing the partitioning in both the datasets while reading them & in the partitioning tab of the join stage i'm performing the Hash partioning on the join keys & enabled the perform sort (sorting the keys ascending).
Then i was writing the resultant in the target dataset.
But while running the job,i'm getting the warning like
JN_stage: When checking operator: User inserted sort "JN_Stage.LnkDS_Input_Sort" does not fulfill the sort requirements of the downstream operator "APT_JoinSubOperator in JN_Stage"
How to handle these kind of warnings.
Note : When I tried using the external Sort stage for sorting the records to JOIN stage & done a hash partition on the Sort Stage & used same partiton in the JOIN stage.I'm not getting any warnings.
But it was suggested by our client not to use external sort stage for sorting the records to the JOIN/Merge/CDC stage.
Thanks in advance
**Note: Subject changed to be more descriptive - Content Editor **