Search found 3835 matches

by eostic
Wed Oct 06, 2010 6:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Segmentation Error using XML Input
Replies: 8
Views: 2693

"I tried Server Job as well....to vain"..... The answer may be there --- Server Job certainly can't generate "osh" type errors......but I've seen cases where Server will yield a decipherable error when EE blows up because of a datatype/syntax/memory constraint type of problem. Wh...
by eostic
Tue Oct 05, 2010 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Segmentation Error using XML Input
Replies: 8
Views: 2693

hard to say...if this is the first time using the stage, it "could" be something really screwy, or a config/install type of issue...... ....but another thing to check is size...how big is the document. Various strange symptoms will occur if the doc is greater than 200 or 300 Meg.... ....an...
by eostic
Mon Oct 04, 2010 8:42 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Default XML Name Space issue
Replies: 2
Views: 2064

Check out exactly what release you are on....since 8.1 with FP1 applied, I've seen much more consistent behavior with namespaces...prior to FP1 there were numerous issues. If the XML is small, I've resorted to just passing it thru a transformer and zapping out the namespace details in the header and...
by eostic
Mon Oct 04, 2010 7:52 am
Forum:
Topic: shared table creation wizard requires smaller batches
Replies: 8
Views: 8707

What Operating System are you on? What database are you using for xmeta? I haven't seen performance issues on Connector import, so I haven't analyzed that, but I've done a lot with analyzing things like Automated Services.....so this may be meaningless for your scenario, but it would be interesting ...
by eostic
Mon Oct 04, 2010 5:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to insert XML into Oracle CLOB datatype.
Replies: 6
Views: 4140

Test a Server Job's Oracle Stage and see if it can write to your particular column type, and then use a Folder Stage in Server to read the xml. If that fails, you could "experiment" with Folder inside of a Server side Shared Container, but passing long strings across the server/ee boundary...
by eostic
Mon Oct 04, 2010 5:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQGet from datastage job
Replies: 1
Views: 981

it's by default....the MQ stage as a source will keep the job "always on"....immediately processing the message when it arrives. You can certainly "start" the job initially using a trigger mechanism, but once it is running it will just "be there" waiting for a new messa...
by eostic
Fri Oct 01, 2010 11:47 am
Forum:
Topic: shared table creation wizard requires smaller batches
Replies: 8
Views: 8707

Anybody's guess. I wonder if it ran out of memory trying to do the work. Are you familiar with WAS and how to check the available heap size? Again, just a guess -- I wouldn't change anything at this point, but it might be something to look at. Sounds like an interesting application. What's your goal...
by eostic
Thu Sep 30, 2010 2:42 pm
Forum:
Topic: shared table creation wizard requires smaller batches
Replies: 8
Views: 8707

Certainly "2" shouldn't cause any problems, and I haven't heard of performance issues in this area. I will assume you are doing this from inside of DataStage using the Shared Table Creation wizard..... This one is news to me, but perhaps (this is just a guess) it has something to do with t...
by eostic
Wed Sep 29, 2010 6:31 pm
Forum:
Topic: addedbunch of new shared tbls; ran auto svs nothing changed?
Replies: 4
Views: 2184

Hard to say....there are a lot of things going on. For starters though, I would question the need to have a 1000 Jobs collecting Operational Metadata.....you may have a great reason, but it is something to think carefully about. The biggest value for OMD is for validating that target systems are wri...
by eostic
Wed Sep 29, 2010 3:47 pm
Forum:
Topic: addedbunch of new shared tbls; ran auto svs nothing changed?
Replies: 4
Views: 2184

There are several ways to map shared tables to a DataStage Job for data lineage purposes. Operational Metadata (OMD) is only one of them, and has the most complex steps. I suggest that you first start with the other two methods --- get those working, and then move on from there to OMD. I'm working o...
by eostic
Tue Sep 28, 2010 3:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: change xpath expressions of xml Dymanically
Replies: 7
Views: 3572

Very nice! That's great! I haven't seen a use case that demanded it (usually the variety is very low, or else dramatic and impacting downstream stages making a separate path of stages a requirement). Can you describe how #JPass1# changes? Does it ever include multiple nodes (slashes embedded in its ...
by eostic
Tue Sep 28, 2010 7:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Input stage mapping problem
Replies: 10
Views: 3186

In this example, that is only likely to happen if you had a "blank" value coming in for one of your rows.... meaning that one row had an attendee value of "John" and another row had an attendee value of " ". It's unlikely that you would get two attendees here unless the...
by eostic
Tue Sep 28, 2010 6:30 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML Input stage mapping problem
Replies: 10
Views: 3186

In my last posting, I had you check "replace NULLS with empty values" so that you would be sure to see the results of your test...... When you uncheck this, NULLS "do not appear" (meaning...no tag comes out at all...) ....that is the default behavior and sounds like what your ven...
by eostic
Tue Sep 28, 2010 5:33 am
Forum:
Topic: Import via ODBC Metabroker Overwrites Descriptions
Replies: 17
Views: 7776

ok...good thread. This is a valuable, albeit less common scenario. I'd like to dig into it a bit further, as there may be others that are like it depending on Stage, Job type, data format, etc.... What exactly do you mean by: "a bunch of Table Defs that accurately reflect exactly what's in the ...
by eostic
Mon Sep 27, 2010 9:23 pm
Forum:
Topic: Data Lineage steps
Replies: 1
Views: 1401

It's a big topic. Not sure exactly where to start --- certainly be sure to read thru the workbench users guide...it has good info there. But here are some things to think about initially.... -- consider learning how data lineage works by using a single large job that you are very familiar with. Sele...