Search found 3835 matches

by eostic
Fri Dec 03, 2010 1:33 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Create xml files from flat files using schema file
Replies: 11
Views: 10274

That was a typo up above. ; ) We're talking xslt here.... All I am implying with xslt (using either the XMLTransformer Stage or the new XML Stage in 8.5) is that xslt is the only way that you would be able to make the parsing and column work entirely dynamic..... and even then, it probably won't del...
by eostic
Fri Dec 03, 2010 7:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Create xml files from flat files using schema file
Replies: 11
Views: 10274

How dynamic do you need it to be? If you want to send the job an "externally" defined specification, then you will have to use xslt and supply that to the job at run time in the desired xml stage... ...then it's really more of an xsllt project, with the xslt conforming to DataStage and the...
by eostic
Tue Nov 23, 2010 3:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML help generating same column more than once
Replies: 5
Views: 1691

Ok....well, without seeing the rest of your job and details, one would anticipate your job to work fine with: 3 rows coming in... 3 "values" for the GroupID column on the link. A B C In the "Description" property of the input link of the xmlOutput Stage, you'd have the following ...
by eostic
Tue Nov 23, 2010 3:37 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: URGENT : XML File Size Limit
Replies: 4
Views: 2623

Figure that in pre 8.5, you'll start having issues around 200M....your mileage may vary, because it depends on a whole lot of things such as the number and size of the element names and the length and values within the document......but that seems to be about average, even though I've seen bigger wo...
by eostic
Tue Nov 23, 2010 2:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: URGENT : XML File Size Limit
Replies: 4
Views: 2623

Hi Deb. The methodology in 8.5 changes how DataStage reads xml, and any size issues are effectively eliminated. But in 8.1 and lower, the document needs to be broken up externally first. I've seen some tooling that can do it, namely xmlMax, but I don't think its available in Windows. I've also seen ...
by eostic
Tue Nov 23, 2010 2:47 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML help generating same column more than once
Replies: 5
Views: 1691

It's a repeating list....so the userid values need to be 3 "rows" coming in....UserGroupID, with 3 values....

Ernie
by eostic
Fri Nov 19, 2010 6:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Access Java services
Replies: 1
Views: 794

Look thru the forum for entries on "JavaPack".....you can either integrate this class with the java api calls needed to directly interact with the DS Engine, or else write another class that talks to DataStage and also talks to your particular java program. Look at my blog below also. I ha...
by eostic
Thu Nov 18, 2010 7:45 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Infosphere in the cloud
Replies: 4
Views: 1480

Hi Tim... I was asked to do some early QA on it, but it's been awhile. It was pretty cool to use a credit card to sign up for it, and then be able to create my "nodes", configure IP addresses, and then select the pieces I wanted/needed. It all worked great --- I was fairly impressed with t...
by eostic
Tue Nov 16, 2010 10:04 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Help with XML Input
Replies: 8
Views: 5229

Ok....you are on the right track. You can import xml directly without the xsd....but it's very important that you break things down. Import the metadata again. Import ONE column. Maybe Ds_Combinacao. It is an attribute. After you import it, look at the tabledef. Scroll over to the right. The datatyp...
by eostic
Fri Nov 12, 2010 1:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parallel JOB does not work with Web Service
Replies: 2
Views: 5302

Search around....depending on your platform, there are a variety of environmnet vars that have to be set so that the EE job initiallizes the java environment correctly. It was patched at some point, but you should be able to get it going once you find the right settings for DATASTAGE_JRE and DATASTA...
by eostic
Wed Nov 10, 2010 1:29 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Web Service
Replies: 2
Views: 1044

I haven't done it in a couple of releases, but the stage naturally supports what I like to call "pass thru".......after you have things working with the web service, with the valid columns as defined in the wsdl, just add the same column name on the output link as on the input link, with i...
by eostic
Wed Nov 10, 2010 1:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Are there any size limit for the return of a web service?
Replies: 1
Views: 979

Depends on why it fails...like anything in this area, it probably depends on a lot of factors.... However, I've successfully returned payloads from web services that are as large as 10 and 20 meg. How big is yours? What you may need to do is increase the heap size....while looking at your WSTransfor...
by eostic
Wed Nov 10, 2010 1:21 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: IBM Support for 1gb or more size XML file.
Replies: 15
Views: 13370

No...xslt "is" the problem. The xmlInput Stage (the "old" pack technology) uses xslt under the covers. It requires that the document be entirely loaded into memory.

Ernie
by eostic
Wed Nov 10, 2010 10:02 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to validate mandatory fields in XML
Replies: 1
Views: 1724

Sounds like you may have two different issues going on.... First, if an element is truly mandatory in the xsd, and the xsd is listed inside the header of the xml document (usually with an attribute something like NoNameSpaceSchemaLocation="<your fully qualified xsd>"), then you can check t...
by eostic
Wed Nov 10, 2010 9:50 am
Forum: General
Topic: url to file
Replies: 9
Views: 2764

Somewhere in the 7.x.y scenario, it was included automatically. It may just "be there" in your palette. You should see the "JavaTransformer" and "JavaClient" stages in your realtime category.

Ernie