Search found 3045 matches

by vmcburney
Thu Jun 02, 2005 5:56 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: A somewhat odd question about parameters and environments
Replies: 2
Views: 724

This is exactly what I am implementing at the moment, replacing a Unix script based system, the main reason I chose it is that it encrypts the password parameters in all places and it lets us use "View Data" in our development environment. Passwords appear as encrypted **** strings when they are set...
by vmcburney
Tue May 31, 2005 11:59 pm
Forum: Data Integration
Topic: Gartner ETL Magic Quadrant for 1H05
Replies: 0
Views: 3114

Gartner ETL Magic Quadrant for 1H05

This is the first ETL magic quadrant since IBM purchased Ascential. Ascential has now clearly moved ahead of Informatica in terms of "Completeness of Vision" while they remain level pegging in "Ability to Deliver". Oracle makes the big move into the Leaders quadrant and Business Objects are now on t...
by vmcburney
Tue May 31, 2005 4:40 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Activity Stage worse in 7.5.1
Replies: 2
Views: 1201

Got the response back from Ascential support - this is not a bug. You can no longer copy job activity stages, change the job name and retain parameter settings. Under the latest version you have to manually set the job parameters for each and every job activity stage. So if you have one hundred jobs...
by vmcburney
Tue May 31, 2005 4:25 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Delta load methodology
Replies: 5
Views: 1758

Your delta date is stored in the Oracle database, it is easy to retrieve this from a sequence job using a routine. From the routine run the DSExecute Unix command SQLPLUS and pass it the select statement as an argument. This will return the result of the SQL in the command output. Parse this output ...
by vmcburney
Mon May 30, 2005 5:48 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Parallel update to DB2
Replies: 8
Views: 1927

A splitter will not do much for your job and may be making it slower because the entire job is still only running on a single CPU. To get the most from parallel processing you need to make it a multiple instance job and run your four streams as different instances of the job that partition the data.
by vmcburney
Sun May 29, 2005 6:23 pm
Forum: IBM QualityStage
Topic: Quality Stage Plugin
Replies: 4
Views: 3633

Consider making some of your qualitystage plugin properties job parameters. Especially the trace level. That way when you hit a problem you can run it again with a higher trace level. You may also find situations where you deliver to your (hopefully) readonly production environment, find a problem g...
by vmcburney
Sun May 29, 2005 5:57 pm
Forum: IBM QualityStage
Topic: Implementation of QualityStage
Replies: 2
Views: 2023

Since all your files have the same columns you just write a parallel job that processes files using a file mask, or pass in the different file names as a job parameter, and process them with the one datastage job and the one plugin qualitystage job. Dynamic rules depends entirely on what rules you n...
by vmcburney
Sun May 29, 2005 4:15 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Datastage best practices doc needed
Replies: 3
Views: 1444

Would love to help you pretend to be a DataStage expert for your client unfortunately there is no instant DataStage best practices publicly available and this type of knowledge has to be gained from trawling forums and actually using DataStage.
by vmcburney
Fri May 27, 2005 12:38 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSDB2 Plugin- Unable to locate Server
Replies: 7
Views: 1679

You may also need the following:
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$INSTHOME/sqllib/lib;export LD_LIBRARY_PATH

and

PATH=$PATH:$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc
by vmcburney
Fri May 27, 2005 12:33 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Concatenate Reject Codes
Replies: 3
Views: 1099

Use stage variables. Create one stage variable per field and give it a meaningful name. Create an IF statement in that stage variable that sets it to a reject code if the rule fails or sets it to '' if it succeeds. Have a stage variable at the bottom of your stage variable lists that concatenates al...
by vmcburney
Fri May 27, 2005 12:29 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job aborted, i want to start excution from where it aborted
Replies: 6
Views: 1331

You might also need to round your @INROWNUM count down to the nearest commit point. If you are commiting with a transaction size of 1000 and you fail after 11323 rows you may have committed just 11000 of those rows. If you have the transaction and array size set to 1 then this makes reject handling ...
by vmcburney
Thu May 26, 2005 10:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: DSDB2 Plugin- Unable to locate Server
Replies: 7
Views: 1679

The DB2 plugin will not use any of your ODBC settings and I don't think it will use your DB2 binding either. It depends heavily on the configuration of the DB2 client on your machine and the settings in your dsenv file. I would try to import plugin table definitions through the DataStage Manager. I ...
by vmcburney
Thu May 26, 2005 9:54 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job Activity Stage worse in 7.5.1
Replies: 2
Views: 1201

Job Activity Stage worse in 7.5.1

Don't know if you've noticed a new "feature" in 7.5.1 sequence jobs. The Job Activity stage used to have a combo box with the job name in it, a short cut when setting up a new job activity stage was to copy one with the parameters already set and switch job names. It kept the same parameter settings...
by vmcburney
Thu May 26, 2005 6:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate key generation - best practices
Replies: 7
Views: 4236

Agree with all Ray says there. We are currently generating them in the RDBMS target. I prefer generating them in DataStage. As well as the reverse hash file lookups it also helps for data augmentation - where a parent record or lookup is missing and the job needs to add it on the fly. Helps for jobs...
by vmcburney
Wed May 25, 2005 5:50 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Ascential Certification
Replies: 9
Views: 4263

The Ascential certification program has gone the same way as the Ascential Blog network and the Ascential devnet. It is a good idea to start with, there is a lot of activity and announcements, after a few weeks it is dead in the water. The blog network had several weeks of posts but has been stagnen...