Search found 3045 matches

by vmcburney
Tue Apr 11, 2006 7:25 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Getting surrogate keys back from a db2 sequence
Replies: 12
Views: 3320

I don't like this design as the sparse lookup is a very expensive overhead on your job. You've got to ask what advantage you are getting from using a DB2 sequence when you have to retrieve it for every row. I think you would be better off generating keys within your job using a parallel counter, ret...
by vmcburney
Tue Apr 11, 2006 5:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage Enterprise Edition Parallel Extender Certification
Replies: 5
Views: 1419

Have a look at the test objectives on the IBM website as it has a list of topics to be covered in the exam. Tick off each subject as you study it. The existing EE courses will be useful but there is still likely to be something you need to study that wasn't covered in the course. As to a certificati...
by vmcburney
Tue Apr 11, 2006 5:45 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HAWK requirements
Replies: 6
Views: 1632

Someone pointed out to me in a private message that you can install components on different machines, so a metadata server on one machine and the DataStage server on another. Only the DataStage server would require the multiple CPUs.
by vmcburney
Mon Apr 10, 2006 9:28 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: HAWK requirements
Replies: 6
Views: 1632

From the Beta 1.0 installation guide the metadata server requires 2GB for RAM and 4GB of disk space plus it requires a WebSphere Application Server version 6.0.2 (which is bundled with the beta software). The repository requires DB2 version 8.2 (also bundled). The DataStage Server requires 2GB of RA...
by vmcburney
Sun Apr 09, 2006 5:51 pm
Forum: Site/Forum
Topic: Do we need a General Forum?
Replies: 13
Views: 6610

The sin bin is a bit too unfriendly for a social site and it could result in duplicate posts if the original is locked out. Posting to the wrong forum isn't the end of the world, if you want to make maintenance easier give Move Thread rights to everyone with over 200 posts. They should be able to ju...
by vmcburney
Thu Apr 06, 2006 5:38 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Tab Delimited file Delimited Value in the stage properties ?
Replies: 3
Views: 2817

Probably better to name it as a TSV file! Or a txt file. Calling it CSV is a bit misleading since it isn't comma seperated. Import the file definition through the DataStage Manager and you will see tab delimited as one of the seperator options. This will also bring in the field names. Drag and drop ...
by vmcburney
Wed Apr 05, 2006 7:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage logic vs SQL
Replies: 14
Views: 10409

I really like those policies, the show a good knowledge of the strengths of an ETL tool and metadata lineage and reporting. We had a very good example today of the ETL v SQL debate. We have a fact summary table built from a fact detail table. It could be written as a fairly simple insert into SQL st...
by vmcburney
Wed Apr 05, 2006 5:56 pm
Forum:
Topic: About MetaState
Replies: 5
Views: 1826

Welcome to the metadata forum, a bit of a shaky start, you did spell MetaStage wrong in the title but you came good in the post. Just to add to the excellent answers so far, being a metadata hub it sucks metadata in and that metadata is largely readonly. You can enrich your metadata knowledge throug...
by vmcburney
Wed Apr 05, 2006 12:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: PX jobs performing slow
Replies: 11
Views: 4498

I would expect that a DB2 client on Solaris would be able to connect to a DB2 server on AIX, and therefore the EE stage could use that client connection. Have you got a copy of the DB2 Remote Configuration Guide? I noticed someone uploaded the latest version to developernet just a week or two ago.
by vmcburney
Wed Apr 05, 2006 12:40 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: message handler disabled
Replies: 4
Views: 929

There are some parallel warning messages that are either unavoidable or only avoidable by making the job less efficient with a workaround. The same is not true of server jobs, server jobs get far less warnings and a well designed server job shouldn't get any warnings at all. It is one of the pleasur...
by vmcburney
Tue Apr 04, 2006 2:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: running parallel jobs
Replies: 4
Views: 856

Don't forget Linux! :D Parallel jobs run fine on Linux too.
by vmcburney
Mon Apr 03, 2006 6:18 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Read only project?
Replies: 6
Views: 1426

There is a FAQ on how to make jobs readonly, I would look to see if the Administrator locked project option is on first and then move to the other readonly job methods.
by vmcburney
Sun Apr 02, 2006 6:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Integrating Data with GIS
Replies: 2
Views: 789

The QualityStage plugin for DataStage has address parsing, identification and barcoding for locating mailing addresses. I think there is also some geolocation functionality, not sure on this as it doesn't seem to appear anywhere on the web site.
by vmcburney
Sun Apr 02, 2006 5:29 pm
Forum: DSXchange Testimonials
Topic: Keep up the good work friends!
Replies: 8
Views: 18947

Well I hate to self-promote (not) but there are some blog entries for new users such as DataStage tip for beginners: developer short cuts and Incremental Loads save the day or DataStage tip for beginners - avoiding Stage Amnesia.
by vmcburney
Thu Mar 30, 2006 5:55 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: difference between Dynamic RDBMS,ODBC and Oracle OCI Stage
Replies: 1
Views: 897

The Oracle OCI stage and the Dynamic RDBMS stage should use exactly the same connectivity to access the Oracle database so they should give the same performance. The main difference is the Oracle one may have an extra couple of Oracle settings. Have a look at each one to see which you prefer. The dy...