Hi,
I'm evaluating a job for optimization/performance etc, and I see that there's a JOIN being used. One of the reference file can be upto 6MB. Is it advisable to go for LOOKUP in place of this JOIN ?
Thanks
Search found 193 matches
- Thu Aug 09, 2007 12:23 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: 6MB in Reference Data: OK for Lookup Or go for a JOIN
- Replies: 1
- Views: 1050
- Thu Jul 19, 2007 8:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job Parameter in Shared Container
- Replies: 1
- Views: 1254
Job Parameter in Shared Container
Hello, I'm having difficulty in accessing a Job Parameter in a Shared Container. The Shared Container, as such, in its Job Properties, has no Job Parameter defined. The Parent Job calling this Shared Container has few Job Parameters, which I would like to access in a Transformer in the Shared Contai...
- Mon Jul 02, 2007 7:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Phantom Output file
- Replies: 2
- Views: 1297
Phantom Output file
Hi, Couple of jobs in production failed for our In-Job Controls. Contents of phantom output file => DataStage Job 362 Phantom 4901 EFF_Extractor.Input_File not found in RT_CONFIG (2). EFF_Extractor.Transformer_1 not found in RT_CONFIG (2). EFF_Extractor.Input_File not found in RT_CONFIG (2). EFF_Ext...
- Sun Jul 01, 2007 7:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: does Datastage Handle ascii extended chars
- Replies: 3
- Views: 3825
we are receiving international data Is there any spceail charachter set you are receiving? You need to check for your project's NLS map and collation locale setting. If you get any error due to unhandling of special character while running job, then you need to set appropriate setting for your proj...
- Thu Jun 28, 2007 4:36 pm
- Forum: General
- Topic: The NEW DSX logo
- Replies: 26
- Views: 14522
Re: The NEW DSX logo
Change to the DSXchange logo is coolgateleys wrote:Couldn't help but notice the new DSX logo? Looks cool ..... more "In your face" kinda look. And check out those 'solar flares' emanating from the logo. Hmmm!!
Is there any other changes?
- Tue Jun 26, 2007 7:12 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Overhead due to "Allow Multiple Instance"
- Replies: 2
- Views: 1468
Re: Overhead due to "Allow Multiple Instance"
Hi, For loading large volume of records from a sequential file to a DB2 database table,I noticed that the speed inreased significantly(it almost doubled) if I checked the "Allow Multiple Instance" chek box. I just want to know if this would inrease overhead in some way or would it have an...
- Tue Jun 26, 2007 5:09 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: choose compare/difference/change data capture
- Replies: 4
- Views: 2090
Re: choose compare/difference/change data capture
How do I choose between the compare, difference, and change data capture stages. It appears to me that the change data capture stage does everything that compare and difference do so I have always used change data capture. Am I missing something? I hate it when I am missing something... Yes Change ...
- Sun Jun 24, 2007 9:27 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Problem passing parameters to STPPX stage in shared containe
- Replies: 1
- Views: 993
Re: Problem passing parameters to STPPX stage in shared cont
Hi all. I am using an STPPX stage within a shared container and I'm having problems passing parameters to this stage from the properties tab in the shared container. In the STPPX, I've parameterized the db credentials, name and source. When I run my job I get the following warning and fatal error. ...
- Sat Jun 23, 2007 6:22 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Pivot stage question
- Replies: 13
- Views: 4899
Re: Pivoting
I am a newbie at this, it is my first post, so please bear with me. I do a tremendous amount of pivoting in the work I do, and have not been very impressed with the pivot stage. I have 2000+ input formats that I have to standardize into one of a few standard formats. These input formats range from ...
- Sat Jun 23, 2007 6:15 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Performance Tuning
- Replies: 3
- Views: 1214
Re: Performance Tuning
I have a question relating to job performance, one of the job is doing a normal lookup directly from the oracle table to retrieve ID, there are over 9 million records in the table and this lookup causes the performance to decrease. how can i increase the efficiency of this job? Thanks Yes...If look...
- Fri Jun 22, 2007 6:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Remove duplicates problem
- Replies: 11
- Views: 3589
What I want to do is to remove the duplicates based on UIDCONTRACT, and obtain the first row i.e. the row with priority 1. I thought about using an aggregator stage bu that just brings back all the rows as I cant leave out the description. You can achieve the same with just Dataset-->Sort-->Dataset...
- Fri Jun 22, 2007 6:02 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Execute Same Job with 3 files?
- Replies: 4
- Views: 952
Re: Execute Same Job with 3 files?
Hi , My requirement is I am getting 3 source files with same meta data and I have to design one job in that I have to load these files one after the other.In the Target table I have to append the Seconefile Data to the first file and so on.. While reading the first file if i encounters any problem ...
- Thu Jun 21, 2007 7:20 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unbearably slow compile with a funnel
- Replies: 7
- Views: 2490
I'd be surprised if it actually takes all that time to do the physical compile. We've seen situations like this in the past, where the compiler license limits the number of concurrent compiles - sometimes even restricting it to one user at a time. This seemed to translate into long wait times for t...
- Thu Jun 21, 2007 7:13 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Pivot stage giving very poor performance
- Replies: 8
- Views: 3383
- Wed Jun 20, 2007 9:11 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Unbearably slow compile with a funnel
- Replies: 7
- Views: 2490
Ray, Initially the job started compiling better with the change of funnel option but then it started getting slow again. I removed the funnel stage altogether and it is compiling much better now. There almost 10 links to the funnel does this have to do with anything.... except for this job rest of ...