Job warnings

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
pravin1581
Premium Member
Premium Member
Posts: 497
Joined: Sun Dec 17, 2006 11:52 pm
Location: Kolkata
Contact:

Job warnings

Post by pravin1581 »

Hi All,

I am getting warnings like sort key no longer exists and it will be dropped from the inserted sort merge collector. This warnings are generated for all the sort keys. The design of the job is there is an input link, data is sorted and hash partitioned in the sort stage, then same partitioned is carried to the remove duplicate stage on the same keys to remove duplicates and then data is loaded into Teradata using Enterprise stage. When we replace the enterprise stage with dataset then these warnings are gone. The enterprise stage is a parallel stage. Please let me know how can I resolve these warnings.

Thanks in advance.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

By now (491 posts) you should realize that we need exact error messages. Without these we're wasting time guessing. Oh, and disable operator combination before capturing the error messages, so that you know from which actual operator they are being generated.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Kumar@1988
Participant
Posts: 6
Joined: Wed Dec 29, 2010 12:25 am

Re: Job warnings

Post by Kumar@1988 »

:?:
Hi,

In ur job ur useing sort stage then after remove dupilicate stage is useing can u remove the dupilicates in sort stage itself so u can try on that option then u may get.......
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Re: Job warnings

Post by ray.wurlod »

Kumar@1988 wrote: :?:
Hi,

In ur job ur useing sort stage then after remove dupilicate stage is useing can u remove the dupilicates in sort stage itself so u can try on that option then u may get.......
As previously admonished, please strive for a professional standard of written English on DSXchange. What you have written above does not fall into that category.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
pravin1581
Premium Member
Premium Member
Posts: 497
Joined: Sun Dec 17, 2006 11:52 pm
Location: Kolkata
Contact:

Post by pravin1581 »

ray.wurlod wrote:By now (491 posts) you should realize that we need exact error messages. Without these we're wasting time guessing. Oh, and disable operator combination before capturing the error messages, so that ...
The warning messages are :-

Code: Select all

  Sort key <key name> no longer exists in the dataset schema. It will be dropped from the inerted sort merge collector.
The above warning is repeated for all the sort keys defined in the sort stage and finally

Code: Select all

There are no sort keys in the dataset schema. No sortmerge collector will be inserted.

These warnings have started coming when the target dataset stage has been replaced with the TD enterprise stage.[/code]
pravin1581
Premium Member
Premium Member
Posts: 497
Joined: Sun Dec 17, 2006 11:52 pm
Location: Kolkata
Contact:

Post by pravin1581 »

Any replies will be appreciated.
JRodriguez
Premium Member
Premium Member
Posts: 425
Joined: Sat Nov 19, 2005 9:26 am
Location: New York City
Contact:

Post by JRodriguez »

Is runtime column propagation check?

Probably you have check runtime column propagation, the keys still exist in the stream ... just uncheck it and let us know
Julio Rodriguez
ETL Developer by choice

"Sure we have lots of reasons for being rude - But no excuses
pravin1581
Premium Member
Premium Member
Posts: 497
Joined: Sun Dec 17, 2006 11:52 pm
Location: Kolkata
Contact:

Post by pravin1581 »

RCP is not on.
pravin1581
Premium Member
Premium Member
Posts: 497
Joined: Sun Dec 17, 2006 11:52 pm
Location: Kolkata
Contact:

Post by pravin1581 »

pravin1581 wrote:RCP is not on.
Any suggestions .
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

pravin1581 wrote:Any suggestions .
:idea:
Suggestion: Learn that DSXchange is an all-volunteer site whose members post as and when they can and, if they have nothing to contribute, will typically not post anything.

If you insist on demanding responses, do so of your official support provider, whom you are paying to provide responses.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
Post Reply