Search found 203 matches

by mouthou
Fri Mar 04, 2016 1:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Bulk insert option in Teradata connector
Replies: 6
Views: 5977

Bulk insert option in Teradata connector

Hi all, I am expecting a source file with more 12 million rows to load in Teradata with truncate & reload requirement. With the regular insert, this would be a time consuming load. Please let me know if there is any bulk load option using Teradata connector stage or any suggestion. Couldn't thin...
by mouthou
Wed Jan 27, 2016 11:15 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Read a flat file which have the column data in the next line
Replies: 4
Views: 6110

Re: Read a flat file which have the column data in the next

Even if you had to split the lines by some other programming, what would be your point of view when it comes to identifying the new line or record in the samples given by you. If it is a line wrap introduced by the system itself, then it may be possible for DataStage options to identify the link bre...
by mouthou
Wed Jan 27, 2016 9:32 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Split a source file into multiple files dynamically
Replies: 6
Views: 7034

Re: Split a source file into multiple files dynamically

As far as my understanding goes, I guess this may be achieved by using MODIFY stage which handles the dynamic selection & dropping of columns. Please check the documentation for the stage usage. If the DataStage implementation gets complicated, as another resort unix scripting will also help as ...
by mouthou
Mon Jan 04, 2016 12:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Any feature to create html output
Replies: 7
Views: 6029

Thanks all for your responses. It looks there is some limitation while dealing with html source/target alone, unlike how IBM provided features for XML processing.
by mouthou
Mon Dec 21, 2015 9:00 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Any feature to create html output
Replies: 7
Views: 6029

Hi MrBlack,

I am not getting your suggestion of XLST/XML in relevance to my scenario (as not dealing with XML data at all and XML wont be an issue in DS). My use case is to send the output of a query to .html file so that the target system can make of use it.

Thanks
by mouthou
Tue Dec 15, 2015 9:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Any feature to create html output
Replies: 7
Views: 6029

Any feature to create html output

Hi All,

Is there any feature in DS to put select query result in an html output file. There is set of XML features but not sure if HTML output can be created using DS. Appreciate your opinion if you have tried or any suggestion?


Thanks
by mouthou
Mon Oct 26, 2015 9:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transposing input row into multiple rows
Replies: 7
Views: 2731

Re: Transposing input row into multiple rows

Thanks everyone for the responses. In a way, the approaches using a Transformer only inevitably (be it 25 links or pivot or looping). I went ahead with Pivot & Transformer combination though. As Ray said, Transformer with 25 links could have worked well but it seemed to make the design bulky in ...
by mouthou
Thu Oct 22, 2015 11:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Transposing input row into multiple rows
Replies: 7
Views: 2731

Transposing input row into multiple rows

Hi All, I have a requirement to split each incoming row into 25 output rows. But those 25 output rows need to be created based on the 25 columns in each input row. This may look like pivoting but the difficulty is each such output row is to be created only if there is a valid value in the source col...
by mouthou
Thu Sep 10, 2015 1:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connector stage parameters get reversed to hardcoded values
Replies: 8
Views: 4325

Hi rkashyap, Everything you mentioned has been done. After all that only, I am trying to use the job parameter in the Teradata Connector stage. Even when someone is not using PROJDEF in Job properties but with hardcoded values, the actual Stage where the parameter is used should not point to hardcod...
by mouthou
Wed Sep 09, 2015 8:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connector stage parameters get reversed to hardcoded values
Replies: 8
Views: 4325

So, as you see it is a common error encountered by many others. I am using 8.5 and the issue is still there. I thought to check with DSX folks here if they figured out anything about this. I may have to check on IBM techsupport platform for any clue or may have to open a ticket with them. Thanks for...
by mouthou
Wed Sep 09, 2015 4:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connector stage parameters get reversed to hardcoded values
Replies: 8
Views: 4325

The value of the parameter (as defined in the properties section) gets hardcoded automatically at the places where the parameter is used I am giving as example. A Job parameter is defined as TD_EDW_DB = 'EDW_DEV' I am using the above parameter #$TD_EDW_DB# in a Teradata connector stage for database ...
by mouthou
Tue Sep 08, 2015 10:08 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Connector stage parameters get reversed to hardcoded values
Replies: 8
Views: 4325

Connector stage parameters get reversed to hardcoded values

Hi All, When I use the parameters in the Connector stages, the parameters get reverted to hardcoded values. I thought it must be some unknown issue with the initial 8.0 versions released by IBM. But that issue remains even in the higher versions now. Please let me know if anyone faced this issue and...
by mouthou
Thu Apr 02, 2015 10:38 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Enterprise stage in parallel mode?
Replies: 4
Views: 4038

Thanks for the couple of responses. 1. I am not still clear on the DEFAULT execution mode of Oracle Enterprise stage or any Enterprise as per the response. Are you implying that it is SEQUENTIAL for read and PARALLEL for write? 2. Does the default mode vary for any stage whether it is read or write ...
by mouthou
Tue Mar 31, 2015 1:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Oracle Enterprise stage in parallel mode?
Replies: 4
Views: 4038

Oracle Enterprise stage in parallel mode?

Hi All, I was in a discussion to highlight the difference between Connector stages and Enterprise stages. With the extent that I worked in Oracle Enterprise stage, I replied saying the Enterprise stages are Sequential. Then there was a followup question as how to make Oracle Enterprise stage to run ...
by mouthou
Sat Jan 17, 2015 7:00 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: interesting logical questions
Replies: 5
Views: 1990

interesting logical questions

Hi All, While I was reading some DataStage study materials, I came across some logical questions. Having worked in DataStage for few years but I could only guess the direct answers instead of a logical reasoning. Just thought to put my opinion on this. Appreciate to know if there is anything more fr...