DSXchange

bhargav_dd wrote:appreciate ur response

Ur...

Sorting is performed separately on each partition. If you wish to preserve the overall sorted order when collecting into a sequential operator then you need to specify SortMerge as the collection algorithm.

Don't do it. Use two Lookup stages. It's cleaner.

Every operator in the framework has already been compiled into a class. That's what I mean by them not requiring further compilation.

You can do anything you could do at the operating system shell prompt. Pipelining, redirection... it's all there for you. After all, the stage merely invokes an operating system shell and passes it the command. Be wary, though, that job parameter references can only appear in the Parameters field, n...

Use a Lookup stage with four reference inputs, all linking to the same reference data set.

The error suggests that no Surrogate Key state file has been created in the designated location on the new server.

XML is free format. Your expected and actual results are functionally identical. There are plenty of XML "prettifiers" out there; it is not the purpose of an ETL tool to do that. It is producing valid XML.

Have you thought about the second and subsequent incremental loads? You will need to refresh your reference data set so that it's effectively maintained as a copy of the target table (as closely as may be supported by the columns you are storing there). But, yes, the design should work subject to th...

kanasai167 wrote:i could not find any tutorial teaching how to get data from flat file into the database....

IBM class DataStage Essentials will teach you this knowledge.

Other stages have unvarying methods, so don't need further compilation.

Blocking should group the HARV values together into a set. What match rules are you using? Are there any overflow blocks (review the match statistics)? Any records in an overflow block will be treated automatically as residuals. If that's occurring, review your blocking and matching strategies.

To put it another way, they are derived in the order in which you place them in the grid. You can re-order this grid in the Stage Variable properties window.

Isn't Ray D going? I know he wanted to.

This option is not available for parallel jobs unless they are compiled in trace mode and, even then, is not set in the Job Run Options dialog.