Error when checking composite operator at run-time

[truenorth]

I'm getting this error AT RUN-TIME. I've searched here and on Google and the search results are only about compilation errors.

The job is pretty basic: Oracle source goes to a Data Rule stage where I check for duplicates on a combination of 3 fields and output to a sequential file.

Here is the full log text:

Job_name: Error when checking composite operator: Composite operator output was not redirected.

Thanks in advance.

[ray.wurlod]

Can you please dump the job score to determine what the composite operator is?

[prasson_ibm]

Or you can enable the APT_DISABLE_COMBINATION and execute the job,you will come to know which operator is having issues.

Thanks
PRasoon

[chulett]

Are those really the same thing?

[ray.wurlod]

They are not.

A composite operator occurs when one stage generates two (or, theoretically, more) operators, such as the Data Set stage generating one operator to delete the Data Set and another to populate it, when write mode is Overwrite.

A combined operator (APT_CombinedOperatorController) occurs when the job optimizer groups two or more operators into a single process if they are (a) executing in the same set of nodes, (b) using the same partitioning, and (c) executing in parallel mode.

Therefore disabling combination will not affect composite operators.

[truenorth]

Sorry, I cannot dump the job score of the particular run. It seems our job logs are purged constantly.

However, I did two things:

- put a Transformer between the Data Rule stage and the sequential file
- removed length/precision of 38/10 for an integer column

I don't know which one fixed the problem, but the job ran successfully after the changes.

Will close with a work-around for now.