DSXchange

You should be able to use job parameters there, I do believe.

Show us your changes.

karthi_gana wrote:could you give me the job structure?

ES -> Transformer -> File

karthi_gana also wrote:I have also curious to know, i have 5 files under a folder. will a single job give me the record count for all those files?

Yes.

Show us the syntax you are using in the stage, what you are putting in each of the two property boxes.

There are ways to increase the size of the "block" the error mentions but perhaps another approach - an External Source stage that leverages "wc -l" ? That way you'll get just the two pieces of information you are after without sucking in all that extra baggage.

Hi Craig, No one is using my name. :) I am only using my account. i.e karthik :) OK, good to know. I'll stop worrying that someone may have taken you over. :wink: Actually I thought to use the target table in the lookup. If the records are not matched during lookup, i thought to insert those record...

And what, exactly, does this have to do with QualityStage?

Seems to me you would just select the list of table names and then write them out to a flat file. Nothing in what I posted requires you know anything about the table names or how many there will be on any given day as you are (in essence) building dynamic sql. Write out the first record with just th...

Since that's the case, you might want to consider an alternative to the looping construct - perhaps you can take your table list and construct a single source query where 'union all' is used. For example: SELECT * FROM TABLE_A UNION ALL SELECT * FROM TABLE_B UNION ALL SELECT * FROM TABLE_C Etc, etc....

Excellent, thanks much.

If you check the source code for the DSSendMailTester routine, you'll see what Ray means, how it builds the string that it uses.

Ray, could you touch upon the difference between combined operators and composite operators? Thanks.

Seems to me what you should do is spelled out in the error message.

venkates.dw wrote:This is always a bug. Please report it.

Several jobs? No, but operators within a single job can be combined.

They've always had a mind of their own.