Search found 3045 matches
- Wed Oct 26, 2005 9:24 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to compile an enternal C/C++ Routine and use in DS PX
- Replies: 11
- Views: 4644
Re: How to compile an enternal C/C++ Routine and use in DS P
[quote="maffan76"]Hi, We have recently jumped from Server Version to PX and have to migrate jobs from Server verison to PX. quote] And another thing, you don't have to migrate your jobs from server to PX. You only need to migrate those jobs that need to run faster and would benefit from a ...
- Wed Oct 26, 2005 9:06 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: xml writer
- Replies: 2
- Views: 1144
This is one of those rare cases where it might be a lot easier (and definitely a lot faster) to read and write the XML using sequential file stages instead of XML Input and XML Output. If you are simply reading a numeric value, changing it and writing it back again the XML parsing within a transform...
- Wed Oct 26, 2005 8:59 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Reading xml file
- Replies: 2
- Views: 1247
DataStage flattens XML complex structures into relational records. If you are talking about dividing your XML file into six files with the same record structure then you are better off doing it outside of DataStage. If you are dividing it into six different record structures then you can do it in Da...
- Wed Oct 26, 2005 7:51 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: List of environment variables
- Replies: 13
- Views: 4402
- Wed Oct 26, 2005 7:46 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Project Variable
- Replies: 7
- Views: 2026
Normally you want to avoid plucking env variables from within a routine as it breaks good modular coding practices. Kind of like using global variables in Visual Basic code. The project specific environment variables are set as the default values for job parameters, it is possible that someone will ...
- Wed Oct 26, 2005 7:18 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job process dies at around 1GB RAM usage
- Replies: 7
- Views: 2516
- Wed Oct 26, 2005 3:25 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Problem in using DRS
- Replies: 4
- Views: 1133
As a stab in the dark I would say your job is aborting within the transformer due to some incorrect derivation or routine code. When you reset the job you should see a message appear in the long starting with the words "from last run.." which can contain additional debug error messages (retrieved fr...
- Wed Oct 26, 2005 3:10 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job process dies at around 1GB RAM usage
- Replies: 7
- Views: 2516
So how do people feel about large repeating XML files? Seems to me a misuse of the format. An XML file with one million repeating records also holds one million duplicate definitions of those records which take up as much if not more space then the data itself. Is this incorrect use of XML? Should t...
- Tue Oct 25, 2005 11:35 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job process dies at around 1GB RAM usage
- Replies: 7
- Views: 2516
- Tue Oct 25, 2005 10:48 pm
- Forum: Site/Forum
- Topic: Write a Book!
- Replies: 40
- Views: 20404
- Tue Oct 25, 2005 8:12 pm
- Forum: Site/Forum
- Topic: Write a Book!
- Replies: 40
- Views: 20404
I think your only options are self publishing, which requires a lot of goodwill from Ascential/IBM, or IBM Press. I think IBM Press will want to publish some type of Information Integration book after the Hawk release. You would assume that if IBM Press are taking the book through the normal proposa...
- Tue Oct 25, 2005 6:51 pm
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Job process dies at around 1GB RAM usage
- Replies: 7
- Views: 2516
Yep, the XML reader is a dog. It tries to read the entire XML file as a single document in one very big text field. Very large XML files cannot be handled by the XML input stage as they run out of memory. You are better off processing it via a sequential file stage and parsing it in a transformer. Y...
- Tue Oct 25, 2005 6:15 pm
- Forum: Site/Forum
- Topic: Write a Book!
- Replies: 40
- Views: 20404
Actually with IBM buying Ascential there is now a MUCH easier way to get a DataStage book published which bypasses all the legal problems. I've been toying with the idea of writing a certification guide for the Hawk release and the mythical Hawk certification exam. If anyone is looking to publish a ...
- Tue Oct 25, 2005 2:25 am
- Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
- Topic: Datastage and Progress Database
- Replies: 4
- Views: 1165
- Tue Oct 25, 2005 2:24 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: informatica to ds
- Replies: 12
- Views: 3518