Hi
We are getting a warning in our job when trying to validate. The warning is as below:
JOIN_Records: When checking operator: User inserted sort "{natural="SORT_Guest:InTo_Join_Left.v", synthetic="buffer(0)"}" does not fulfill the sort requirements of the downstream operator "APT_JoinSubOperator in JOIN_Records"
What this error means? Will it have impact while running for a large number of records (in the order of few millions)?
Please reply as early as possible!
Warnings in join stage
Moderators: chulett, rschirm, roy
Warnings in join stage
Vignesh.
"A conclusion is simply the place where you got tired of thinking."
"A conclusion is simply the place where you got tired of thinking."
Hi,
did you sort acording to the stage requirments?
look in the help for it.
did you sort acording to the stage requirments?
look in the help for it.
I guess that's part of why some people turn to the sex industry as well j/k )_________________
Vignesh.
"Choose a job you love, and you will never have to work a day in your life
Roy R.
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
Time is money but when you don't have money time is all you can afford.
Search before posting:)
Join the DataStagers team effort at:
http://www.worldcommunitygrid.org
-
- Participant
- Posts: 75
- Joined: Tue May 13, 2003 4:14 am
- Location: California
- Contact:
This error message shows up when you are trying to do something down the stream that utilizes the sort data.
Your sort key(s) must fit that stage's key(s). If it's an aggregator, you need the same keys. If it's a remove duplicate, you need one extra sort field beyond the keys. The list goes on.
Hope this help you figure out the problem.
Your sort key(s) must fit that stage's key(s). If it's an aggregator, you need the same keys. If it's a remove duplicate, you need one extra sort field beyond the keys. The list goes on.
Hope this help you figure out the problem.
I believe it's how the stages work, and based on limited experience using the sort stage apart from the stage it's being used for. Typically, for the remove duplicate, I would use the embedded sort.
However, I think Remove Duplicates sorta expect that data be somehow sorted beyond just the key. If you just sort on the keys, you have no guarantee that you will get the record you want, so the stage is only being extra-cautious in requiring this.
I may be wrong, and will have to test this again when I'm done with crunch-mode at this client. I would suggest that experimentation be done on those sorts -- if it doesn't work, try adding an extra field, or taking out the extra fields.
However, I think Remove Duplicates sorta expect that data be somehow sorted beyond just the key. If you just sort on the keys, you have no guarantee that you will get the record you want, so the stage is only being extra-cautious in requiring this.
I may be wrong, and will have to test this again when I'm done with crunch-mode at this client. I would suggest that experimentation be done on those sorts -- if it doesn't work, try adding an extra field, or taking out the extra fields.