Write them to a hashed file using the relevant keys. Last one in wins. The Hashed File stage implements destructive overwrite of keys.
Or use a Transformer stage with stage variables to detect change (or lack of) in sorted input.
Search found 53125 matches
- Tue Aug 19, 2008 5:22 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: How to remove duplicates in Datastage server edition 8
- Replies: 5
- Views: 9501
- Tue Aug 19, 2008 4:36 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: issues with merge stage
- Replies: 3
- Views: 1274
Not an environment variable, but you can add more directories (from other file systems) as scratch disk in your configuration file. If the space is being demanded by sorting (necessary for the join stage, ,and inserted by the Framework if you neglect to do so), then you can force the sort to use mor...
- Tue Aug 19, 2008 4:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Change Capture Stage
- Replies: 4
- Views: 2362
Re: warning
I hvae mapped Column3 in the output of the change capture stage.I think that it is not the problem of mapping or not mapping the column (Column3) in the output of change capture stage. Well, Mister Expert, if it's not that what is it? Putting a Column3 on the input link might help, but only if it h...
- Tue Aug 19, 2008 4:31 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unhandled failure (1) encountered calling routine DSU.Execu
- Replies: 8
- Views: 4691
- Tue Aug 19, 2008 4:29 am
- Forum: General
- Topic: Internal Error (81013), DSEngine is empty!
- Replies: 9
- Views: 4307
The only possibility is unintentional or intentional sabotage. There is nothing AT ALL in this product that would clear out everything in the DSEngine directory. Indeed, because certain files (such as SYS.MESSAGE) are open whenever any DataStage process is running, it would be almost impossible to a...
- Tue Aug 19, 2008 4:27 am
- Forum: General
- Topic: Load more tables -> loading order and one transaction
- Replies: 15
- Views: 6686
Your "the only way for a "all or nothing" strategy is to have a common Oracle Stage to load data with Rows per Transaction = 0" would not work for me - I am using DB2. Read again what Craig and I have said. It's robust and reliable. Then get yourself some heavy duty protection because your DBA is go...
- Tue Aug 19, 2008 2:34 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unhandled failure (1) encountered calling routine DSU.Execu
- Replies: 8
- Views: 4691
- Tue Aug 19, 2008 2:14 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Change Capture Stage
- Replies: 4
- Views: 2362
- Tue Aug 19, 2008 2:13 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: how to eliminate first two rows in seqential file
- Replies: 8
- Views: 2380
For that u can use (Head -2) or else go before routine head -2 gives the first two rows - it does not eliminate them. Some shells allow the form head +2 which will eliminate the first two lines. Otherwise use @INROWNUM > 2 as a constraint expression in a Transformer stage downstream of the Sequenti...
- Tue Aug 19, 2008 2:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unhandled failure (1) encountered calling routine DSU.Execu
- Replies: 8
- Views: 4691
Your ExecuteScript routine is returning the value 1. Presumably somewhere in the routine the statement Ans = 1 exists, and is being executed in this case. Conventionally a non-zero exit status in UNIX/Windows indicates other than a successful completion. DataStage extends this convention to the valu...
- Tue Aug 19, 2008 2:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Stored procedure properties
- Replies: 6
- Views: 1978
- Tue Aug 19, 2008 2:04 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Runtime column definition for Oracle Stage
- Replies: 4
- Views: 1293
Let me clarify: The source stage metadata needs to be supplied at runtime as well. Has anyone actually verified that? On one class that I attended it was asserted that RCP enabled yielded the same result as "SELECT * FROM tablename" at least when using the Enterprise stage types. This was given as ...
- Tue Aug 19, 2008 2:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: issues with merge stage
- Replies: 3
- Views: 1274
- Tue Aug 19, 2008 1:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to invoke stored procedure stage
- Replies: 1
- Views: 1014
Re: How to invoke stored procedure stage
I am getting error.Please suggest this error asap.... My suggestion is that the error is "Could not load dsstpora.so" Terms like "urgent" and "asap" generate negative karma, and demotivate us from responding. DSXchange is an all-volunteer site, whose members post as and when they can, if they have ...
- Tue Aug 19, 2008 12:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: score load error
- Replies: 1
- Views: 1036