Search found 4992 matches

by kcbland
Wed Feb 18, 2004 11:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Interview FAQ in PX
Replies: 3
Views: 3849

For your information, we make it a practice on this forum to not assist unqualified individuals in achieving positions or contracts. Not only do they rob the individuals who have taken the time to learn the skills necessary, but they lower the power scale and set an expectation of cheap services. If...
by kcbland
Wed Feb 18, 2004 10:27 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ODBC -- Oracle entries
Replies: 6
Views: 904

Do a "cat /.dshome" to see where the file is located. This is the "engine" directory. You do not need to recycle services to make changes effective in the odbc.ini file or the uvconfig files.
by kcbland
Wed Feb 18, 2004 9:55 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: ORACLE native driver name ?
Replies: 7
Views: 1616

There is no driver. You must install the Oracle client software on your DataStage server. Once that is done, your administrators need to make sure that the tnsnames.ora file is current and has the appropriate connections defined. The DataStage server will use this file for connections, as well as th...
by kcbland
Tue Feb 17, 2004 9:43 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Bumping uvconfig parameters
Replies: 6
Views: 1776

'Weird' or 'sporadic' unexplained 'what just happened' type issues usually indicate that somethings mind was blown. I see that when a high number of jobs are executing and lots of dynamic hash files are being used. This points a greasy finger straight to T30FILES. 15 dynamic hash lookups in an insta...
by kcbland
Tue Feb 17, 2004 6:03 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Kicking Off A DataStage Job From Another Application.
Replies: 6
Views: 2369

Sure, jobs have a command line interface accessible thru a server executable called "dsjob". You can read your manual about this for more detail. If you search this forum for "dsjob", you'll see it's been widely covered. I pasted a ksh script that shows how dsjob can be used via an enterprise schedu...
by kcbland
Tue Feb 17, 2004 6:00 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequential file EOF
Replies: 2
Views: 1053

Have you considered sending output to an aggregator stage of your various metrics (row counts, etc)? Then output the aggregator data to another sequential file to have your metrics. I've done job designs where a "ready" type file is created after the job is finished writing the main file. I stream t...
by kcbland
Tue Feb 17, 2004 5:52 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Bumping uvconfig parameters
Replies: 6
Views: 1776

Are you having any specific problems? Are you running Glance and watching cpu, disk, and memory utilization and seeing anomalous readings?
by kcbland
Tue Feb 17, 2004 5:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: need Datastage license key ( windows 2000 )
Replies: 7
Views: 2163

You are trolling for a lawsuit. No matter how nicely you promise, you are violating the software licensing agreement. Ascential does NOT offer a developer license for individuals such as yourself, so therefore your request cannot be fulfilled. You jeopardize this forum as a participant in facilitati...
by kcbland
Tue Feb 17, 2004 6:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Creation of file with a name taken from a sequential file
Replies: 3
Views: 904

The filename is a job parameter, and the job parameter value is fed by the job control process. The job control process takes care of determining the value by whatever means necessary. Your choices for job control are Sequencers, BATCH, or custom control using the documented APIs.
by kcbland
Mon Feb 16, 2004 9:28 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Poor extraction performance
Replies: 11
Views: 3530

Set the constraint on your bulk load stage to "1<>1" which ensures no rows go down this path but the control file gets created when the job starts. Save some machine cycles! :D Don't evaluate 1<>1. Just use 0 (or the system variable @FALSE, which the compiler replaces with 0) as the constraint expr...
by kcbland
Mon Feb 16, 2004 9:19 pm
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Slowly Changin Dimension
Replies: 8
Views: 3102

I did not see a question here. Are you asking how to design the ETL jobs to support such a task? I would start first with your modeling. You forgot in your model to include a surrogate key for ProductID, maybe ProductKey would be a good name. You also have chosen to use NULL as a startdate. This mea...
by kcbland
Mon Feb 16, 2004 9:01 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Poor extraction performance
Replies: 11
Views: 3530

Your first approach clearly demonstrates what I am trying to tell you: DataStage is single-threaded on Server jobs. Therefore, no matter how fast Oracle can prepare and spool the data, there is a process bound by one cpu to transform it and spool its results to the loading stage. In this case, its a...
by kcbland
Mon Feb 16, 2004 8:36 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Poor extraction performance
Replies: 11
Views: 3530

Well, DataStage Server jobs are single-threaded. This means that the SELECT query is prepared however the database does it, then a process spools the data to DataStage, which is handled in a single-threaded fashion. DS spools the data to a file, then initiates a sqlldr session to load it. Compare th...
by kcbland
Sat Feb 14, 2004 8:14 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Hash Files & Slowly changing dimension
Replies: 7
Views: 6849

Ken Very cool solution. How fast is it? Have you done comparisons to a multiple row lookup? I would think it is a magnitude or more faster. With preload to memory caching, you would expect it to be lightning fast, and it is. One client benchmarked a single OCI lookup using a between statement at 10...