Search found 53125 matches

by ray.wurlod
Thu Apr 05, 2012 4:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is the output of the aggregator stage sorted ?
Replies: 5
Views: 2405

Re: Is the output of the aggregator stage sorted ?

Nsg wrote: if sorted data is input to aggregator / funnel / join / merge stage, will the output data from these stages be also sorted ?a
Yes. Per node. Provided conditions are met such as Sort mode for Aggregator, Sort mode for Funnel.
by ray.wurlod
Thu Apr 05, 2012 4:38 pm
Forum: General
Topic: how to get end timestamp in DSJOB
Replies: 7
Views: 2290

In UNIX use dsjob -jobinfo command. This reports about five lines of information including the start and end timestamps. You can parse these with UNIX commands such as grep and cut.
by ray.wurlod
Thu Apr 05, 2012 4:35 pm
Forum: General
Topic: Auto Purge Log Project Property Change in Production
Replies: 4
Views: 1961

This makes them "subsequently created" jobs.
by ray.wurlod
Thu Apr 05, 2012 5:19 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem of data trunction
Replies: 11
Views: 3674

I assume you are using ODBC as the data connection. Have you imported the table definition from Excel? Tip: you must check the "include system tables" option.
by ray.wurlod
Thu Apr 05, 2012 12:23 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Vertical Pivot Stage
Replies: 14
Views: 9543

Sort and partition by F_N. In stage variables: Map ID to svID if element_name is "ID" otherwise leave svID untouched. svID <== If InLink.element_name = "ID" Then InLink.ID Else svID Map Name to svName if element_name is "Name" otherwise leave svName untouched. Map Value...
by ray.wurlod
Wed Apr 04, 2012 10:42 pm
Forum: General
Topic: Problem with viewing DataStage logs in Unix
Replies: 12
Views: 7091

The -domain option must name the machine on which the services tier is installed (and listening on port #9080).
by ray.wurlod
Wed Apr 04, 2012 10:39 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Format issue with XML output stage
Replies: 4
Views: 2117

So run the legal XML through one of the "pretty print" utilities. DataStage is an ETL tool.
by ray.wurlod
Wed Apr 04, 2012 10:19 pm
Forum:
Topic: FastTrack Mapping Specification Source Columns
Replies: 3
Views: 1599

Welcome aboard. If you have another table-importing product in the suite, such as Information Analyzer or DataStage or Data Architect then, yes, you can create mappings using those shared table definitions directly. That's one of the reasons for having a common metadata repository; ease of collabora...
by ray.wurlod
Wed Apr 04, 2012 6:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Need to handle new line termination for a field
Replies: 11
Views: 4192

Can you please post what the "resolution" is? My point made earlier is that you should NOT remove the newline, at least not without the customer's approval - it's part of the data. So you have to find a mechanism for loading the data in which any character is legitimate. I suspect you've u...
by ray.wurlod
Wed Apr 04, 2012 6:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Problem of data trunction
Replies: 11
Views: 3674

Feeling mellow. Went to awesome CS&N concert last night.
by ray.wurlod
Wed Apr 04, 2012 3:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Size limit on sequential file stage
Replies: 3
Views: 1719

Welcome aboard.

You can't do that with DataStage.

You might try creating the large file then using a UNIX command like split to break it up. This will work even though you are executing on a Windows server - every DataStage installation has MKS Toolkit (UNIX emulator).
by ray.wurlod
Wed Apr 04, 2012 3:26 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Aggregator Issue On Calculating Max value of timestamp field
Replies: 2
Views: 1176

Look at the option for preserving data type in the Aggregator stage.
by ray.wurlod
Wed Apr 04, 2012 3:23 pm
Forum: General
Topic: Capture Rejected records info(from log)
Replies: 2
Views: 983

You can do this using log-interrogation functions DSGetNewestLogId(), DSGetLogSummary() and DSGetLogDetail() - these names may not be totally correct (I'm not using DataStage at the moment).
by ray.wurlod
Wed Apr 04, 2012 3:21 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: .html file creation
Replies: 5
Views: 1699

You might also consider changing the Sequential File stage to use DOS style record delimiter string.