Search found 42189 matches

by chulett
Wed Jul 25, 2012 10:54 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: replace logic in ETL
Replies: 3
Views: 1737

Search for the version of PXEReplace() posted here.
by chulett
Wed Jul 25, 2012 10:51 am
Forum: General
Topic: Reduceing Log information, exclude info entries
Replies: 4
Views: 1333

So... "deprecate" as in not even log them? I thought the message handlers were all about demoting them from one alert level to a lower one rather than saying "don't even bother to write these to the log".
by chulett
Wed Jul 25, 2012 8:41 am
Forum: General
Topic: Reduceing Log information, exclude info entries
Replies: 4
Views: 1333

Re: Reduceing Log information, exlude info entries

Is there a sewtting some where so that datastage only logs warning and above entires? Not that I've ever seen, at least not generically. I'm curious though, what kind of "info" messages are you seeing? Perhaps there is some kind of a "logging level" property in the MQ stage that...
by chulett
Wed Jul 25, 2012 6:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Loading Decimal field data from fixed width Flat Files
Replies: 8
Views: 9220

So there is no way i can use a Transformer stage or any other stage in my parallel job. I have to handle this issue in a schema definition file. And that would be because you are building a generic job that leverages RCP. We probably should have been able to ascertain that but it's always best to m...
by chulett
Wed Jul 25, 2012 6:21 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Issue
Replies: 14
Views: 5449

...I still kept transaction size as 0 as I do not want to commit until all rows are inserted... Do you realize that this might fill up your rollback space and not necessarily increase speed? But can be very common. At one client we ran every job with a zero transaction size so the loads were 'all o...
by chulett
Wed Jul 25, 2012 6:18 am
Forum: General
Topic: Error: The configuration does not contain the invoking node
Replies: 17
Views: 6676

ArndW wrote:you are using a server routine to delete datasets
I've been sitting here, wondering if that might be the culprit but wasn't really sure the why of it.
by chulett
Wed Jul 25, 2012 6:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Logic Reqd.
Replies: 15
Views: 3939

Here's a crazy thought... renew your membership. :wink:
by chulett
Wed Jul 25, 2012 6:10 am
Forum: General
Topic: Job is not in the right state (compiled and not running)
Replies: 60
Views: 17247

Off you go to your own topic...
by chulett
Tue Jul 24, 2012 5:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Import JSON files
Replies: 9
Views: 6970

Looks like rolling up your own mechanism to parse them would be... painful. Can you get your hands on a JSON Parser? I would imagine it could be leveraged via an External Source stage and seems to me it would be the quickest / most reliable way to accomplish this task.
by chulett
Tue Jul 24, 2012 5:14 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Import JSON files
Replies: 9
Views: 6970

I've already moved it. This is the correct forum.

So... these JSON files? First thing I'd ask is what you need to do with them other than "read" them? Knowing what your goal / target is here will help us help you.
by chulett
Tue Jul 24, 2012 4:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash crc empty
Replies: 2
Views: 1085

Guess you figured out the issue. Ah well, let us know if you need any other help with this.
by chulett
Tue Jul 24, 2012 3:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: hash crc empty
Replies: 2
Views: 1085

Cameron, that's not a lot of information to work with. I could attempt to guess what you mean by "HASH CRC" but I'd rather not... can you explain what your job designs look like? Sounds like you may be using hashed files to do existence checks for insert v. update which should be perfectly...
by chulett
Tue Jul 24, 2012 1:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Performance Issue
Replies: 14
Views: 5449

wittyme wrote:changed the array size from 1 to 10000
That was the significant change.
by chulett
Tue Jul 24, 2012 1:27 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: How to substrig delimited variable length fields
Replies: 2
Views: 1515

Don't worry about Index(), the Field() function is there to do exactly what you need.