Search found 136 matches

by aartlett
Sun Jan 21, 2007 11:33 pm
Forum: General
Topic: CR/LF for the new generation
Replies: 45
Views: 21952

Some of the early printers also perform physical carriage return and line feed. Are you referring to those dot matrix printers or impact matrix printers ? :wink: If Ray is of my generation (and from the photos may be the one prior to mine IT wise :) ) then we are talking belt fed impact printers wh...
by aartlett
Wed Jan 17, 2007 9:32 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Right ETL approach
Replies: 8
Views: 1502

Ideally I'd say concat and bulk load,
but .......
1 million records / 12 clusters as inserts ... should only be a few minutes to load as direct insert statements in datastage.
by aartlett
Mon Dec 18, 2006 4:44 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DataStage daylight time saving
Replies: 6
Views: 3867

The rules are different in other countries, particularly in the southern hemisphere. And between states in those countries as well :) Australia has to have one of the worst set of rules for day light savings. Different states may or may not have it, 3 time zones can become 4. States start and end d...
by aartlett
Tue Dec 12, 2006 4:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: New KgdGenHtml zip posted
Replies: 13
Views: 6096

The only problem I've found is the size of the final solution because of the BMP's from designer. I got around that by converting them to jpg and sed'ing the html to change bmp to jpg. I have also added an annotations area as a scroll port in the html, linking to a file in an annotations directory c...
by aartlett
Thu Nov 23, 2006 4:02 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: external xml parser
Replies: 7
Views: 3265

Djoni, Can't think of one off the top of my head, some Google research will probably find one though. The problem with a lot of XML parsers is that they have to store the record in memory until they get to a close off, sort of like recursion. with the whole document being inside 1 tag structure, mos...
by aartlett
Tue Nov 21, 2006 10:06 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: external xml parser
Replies: 7
Views: 3265

djoni wrote: Can Saxxon handle large files, like 2GB?
It's a Java Program so I doubt it. It tends to blow stacks at about 0.5 - 1GB even with ridiculous stack mem sizes.

Why are you getting such hideous files. XML shouldn't be that big.
by aartlett
Tue Nov 21, 2006 4:23 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: external xml parser
Replies: 7
Views: 3265

Djoni,
I have used the Saxxon parser at two sites succesfully. It is very fast and reliable.

You need Java 1.5 to run it.

If you need the scripts I used to call it I'll post it, but only if you can't figure it out :)
by aartlett
Tue Nov 14, 2006 5:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start a job and dis-associate from it
Replies: 6
Views: 1666

ArndW wrote:Andrew,
If you program this in job control or elsewhere, issue a DSRunJob() and don't call the DSWaitForJob() then you have achieved your intended result.
Thanks Arnd and all. It's what I suspected but it doesn't hurt to check :) .
by aartlett
Tue Nov 14, 2006 5:41 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start a job and dis-associate from it
Replies: 6
Views: 1666

Andrew, I don't know how you could easily program concurrent runs of job.a and job.b to trigger an abort of the job.a when job.b aborts. How did you effect this? Could one job aborting set the database status so that the other can't access the DB and thus aborts? Arnd, If the jobs are initiated fro...
by aartlett
Mon Nov 13, 2006 11:42 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Start a job and dis-associate from it
Replies: 6
Views: 1666

Start a job and dis-associate from it

G'day all, I have a need to run a copy (new instance) of a batch job from an executing instance and then make sure that a failure of the first job will not kill the second: EG: a.1 spawns a.2 Normally if a.1 fails, a.2 will also fail. This is not a desirable occurrence. If I use a routine to do a ds...
by aartlett
Wed Sep 27, 2006 8:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: XML/Xalan error
Replies: 9
Views: 3516

Well i'm glad I'm not the only one who hit this issue. I searched to no help. But I did find out: 1) Make sure you have XML Pack 2.0 loaded, it makes loading XSD's a peice of cake 2) the Folder stage at the start needs 2 rows in it: i) FILENAME Varchar(x) ii) LineIn varchar(999999) 3) you will proba...
by aartlett
Mon Sep 25, 2006 5:55 am
Forum: General
Topic: Viewing logs outside of datastage director
Replies: 2
Views: 2889

ray.wurlod wrote:Of course, if you have DataStage 7.5 or later, you can have Director on your PDA.
Still doesn't help if you have only dialup for remote access to your site. But PDA access could be fun:)
by aartlett
Mon Sep 25, 2006 1:00 am
Forum: General
Topic: Viewing logs outside of datastage director
Replies: 2
Views: 2889

Viewing logs outside of datastage director

This is a simple tool I wrote a while ago to view a job log without director. As the remote access I have to use is dial up, going into director can be ... tiresome. I call the file dslogs.ksh. Usage is dslogs.ksh [jobname] [projectname] > [outputfile] Redirection of output is not strictly necessary...
by aartlett
Thu Sep 14, 2006 4:50 pm
Forum: Site/Forum
Topic: Ray on 14000!
Replies: 13
Views: 8186

He was on just after 6 this morning, several posts and gone like a phantom in the night :)

Keep up the good work Ray, we all say we appreciate your's, Kim's, Ken's and all the other top posters work ... probably because we do.
by aartlett
Mon Jul 24, 2006 6:24 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Removing duplicates from 20 million records
Replies: 24
Views: 10057

Thanks folks for helping on this issue. One thing I oberved that the performance of the sort stage is slow. Is there any way to improve the performance of sorter stage. External sort. In Windows get hold of the unix sort command from sourceforge where the unixutils are. these are great for augmenti...