Search found 284 matches
- Tue Jun 08, 2021 2:51 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Exporting executables - best practice
- Replies: 2
- Views: 11704
Exporting executables - best practice
Hi all I have seen a lot of cases where we are asked to export DataStage jobs along with their executables from development to test/UAT/production. Apparently this is a best practice. I don't believe this should be the case (and NO our environments do not lack C/C++ compilers) because personally I p...
- Mon May 15, 2017 1:53 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job compile issue
- Replies: 8
- Views: 7946
- Wed May 10, 2017 8:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job compile issue
- Replies: 8
- Views: 7946
I vaguely recall seeing this behaviour. Try opening the job, making the change, and saving the job. Then, without compiling, open the job again, make the change again if necessary, and save. Don't make any other change to the job. You can try opening the job a third time to check that the change ha...
- Wed May 03, 2017 10:17 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job compile issue
- Replies: 8
- Views: 7946
Does anyone have any tips for this? I have a new problem in the same job, i.e. after managing to compile the job I've noticed that the partitioning that I've set upstream in the transformer stage is not preserved. The next stage is a Pivot Enterprise stage which needs incoming data sorted and hash p...
- Tue Apr 25, 2017 6:06 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job compile issue
- Replies: 8
- Views: 7946
With something like this I would suspect some potential metadata corruption causing the issue. Are you doing a regular compile on your recompile or are you doing a force compile? See if the error repeats each time with a force compile. Will try this asap. If you haven't already, export the job, del...
- Mon Apr 24, 2017 4:57 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Job compile issue
- Replies: 8
- Views: 7946
Job compile issue
I have a job with quite a few join stages and 4 or 5 transformer stages. This is necessary since columns generated in one transformer is used in deducing columns in the subsequent transformer stage. I've been experiencing a peculiar problem when i go to compile this job - it never compiles the first...
- Wed Oct 12, 2016 3:39 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicate entry issue - Lookup stage
- Replies: 12
- Views: 12995
I agree with the theory on principle here Ray. Unfortunately that's not what's happening in my case. I'm on an SMP environment. I've got my stream data partitioned as hash. My reference data is entire partitioned. The config. file I'm using is defined on 8 nodes with the same fastname (thus proving ...
- Tue Oct 11, 2016 1:28 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Parameter Set Import
- Replies: 7
- Views: 7713
- Mon Sep 19, 2016 1:20 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicate entry issue - Lookup stage
- Replies: 12
- Views: 12995
Exactly what I did and found out that I'm on an SMP setup. That said I don't understand why the tenets of SMP aren't being followed here - despite the shared memory pool, my reference file consisting of one and just the one line partitioned using the 'Entire' algorithm gets copied 8 times to my dest...
- Fri Sep 16, 2016 7:08 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicate entry issue - Lookup stage
- Replies: 12
- Views: 12995
Just came across this: http://datastagedoctrina.blogspot.fr/2013/06/know-your-ds-server-architechture-is.html If this is true then I'm on an SMP... and that means my theory in my previous post is wrong. I thus have duplicate entries returned despite being on a SMP configuration - thus shared memory ...
- Fri Sep 16, 2016 6:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicate entry issue - Lookup stage
- Replies: 12
- Views: 12995
Thanks Craig. Just read through that. I'm guessing my server is an MPP architecture which I gather isn't that expensive after all since 2 SMP machines together can become an MPP server. That said, is there any specific command to find out what the architecture is? At least I'm sure now that I wasn't...
- Fri Sep 16, 2016 3:44 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Duplicate entry issue - Lookup stage
- Replies: 12
- Views: 12995
Coming back to this and specifically to Klaus's post: Klaus... What you said is how I had understood the lookup stage functions - entire partitioning should NOT copy each line into each partition. However curiously enough in my setup that's exactly what's happening. I tested with a lookup containing...
- Fri Sep 09, 2016 1:25 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Parameter Set Import
- Replies: 7
- Views: 7713
It appears that our installation was causing this problem. I was told that as long as we had our XMETA DB on the same server as ous DS Engine there wasn't a problem. However of late we migrated our XMETA to a different physical server housing an oracle Database and ever since, after every project cr...
- Thu Sep 08, 2016 8:59 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Parameter Set Import
- Replies: 7
- Views: 7713
I don't think so since I import objects in other projects using the same user ID and I've done this kind of imports earlier. Further... I can't delete the project in Administrator as I get the message: Failed to delete all repository objects for project Serveurxxx/Projectxxx. This may be due to insu...
- Thu Sep 08, 2016 7:33 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Parameter Set Import
- Replies: 7
- Views: 7713
Parameter Set Import
Ladies and gentlemen I have another weird problem regarding parameter sets. I have this perfectly functional parameter set which I've exported as a DSX and am trying to import into a new project with the intention of changing the name since the parameters are global in nature and can be shared by mu...