Search found 284 matches

by TonyInFrance
Tue Jun 08, 2021 2:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Exporting executables - best practice
Replies: 2
Views: 11704

Exporting executables - best practice

Hi all I have seen a lot of cases where we are asked to export DataStage jobs along with their executables from development to test/UAT/production. Apparently this is a best practice. I don't believe this should be the case (and NO our environments do not lack C/C++ compilers) because personally I p...
by TonyInFrance
Mon May 15, 2017 1:53 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job compile issue
Replies: 8
Views: 7946

Not yet Craig. I've been firefighting since we're on a tight deadline... but I guess reporting it would ultimately be the way to go.
by TonyInFrance
Wed May 10, 2017 8:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job compile issue
Replies: 8
Views: 7946

I vaguely recall seeing this behaviour. Try opening the job, making the change, and saving the job. Then, without compiling, open the job again, make the change again if necessary, and save. Don't make any other change to the job. You can try opening the job a third time to check that the change ha...
by TonyInFrance
Wed May 03, 2017 10:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job compile issue
Replies: 8
Views: 7946

Does anyone have any tips for this? I have a new problem in the same job, i.e. after managing to compile the job I've noticed that the partitioning that I've set upstream in the transformer stage is not preserved. The next stage is a Pivot Enterprise stage which needs incoming data sorted and hash p...
by TonyInFrance
Tue Apr 25, 2017 6:06 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job compile issue
Replies: 8
Views: 7946

With something like this I would suspect some potential metadata corruption causing the issue. Are you doing a regular compile on your recompile or are you doing a force compile? See if the error repeats each time with a force compile. Will try this asap. If you haven't already, export the job, del...
by TonyInFrance
Mon Apr 24, 2017 4:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Job compile issue
Replies: 8
Views: 7946

Job compile issue

I have a job with quite a few join stages and 4 or 5 transformer stages. This is necessary since columns generated in one transformer is used in deducing columns in the subsequent transformer stage. I've been experiencing a peculiar problem when i go to compile this job - it never compiles the first...
by TonyInFrance
Wed Oct 12, 2016 3:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate entry issue - Lookup stage
Replies: 12
Views: 12995

I agree with the theory on principle here Ray. Unfortunately that's not what's happening in my case. I'm on an SMP environment. I've got my stream data partitioned as hash. My reference data is entire partitioned. The config. file I'm using is defined on 8 nodes with the same fastname (thus proving ...
by TonyInFrance
Tue Oct 11, 2016 1:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameter Set Import
Replies: 7
Views: 7713

Pretty sure its provided by IBM.
For us it's present in:

/apps/IBM/InformationServer/ASBServer/bin
by TonyInFrance
Mon Sep 19, 2016 1:20 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate entry issue - Lookup stage
Replies: 12
Views: 12995

Exactly what I did and found out that I'm on an SMP setup. That said I don't understand why the tenets of SMP aren't being followed here - despite the shared memory pool, my reference file consisting of one and just the one line partitioned using the 'Entire' algorithm gets copied 8 times to my dest...
by TonyInFrance
Fri Sep 16, 2016 7:08 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate entry issue - Lookup stage
Replies: 12
Views: 12995

Just came across this: http://datastagedoctrina.blogspot.fr/2013/06/know-your-ds-server-architechture-is.html If this is true then I'm on an SMP... and that means my theory in my previous post is wrong. I thus have duplicate entries returned despite being on a SMP configuration - thus shared memory ...
by TonyInFrance
Fri Sep 16, 2016 6:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate entry issue - Lookup stage
Replies: 12
Views: 12995

Thanks Craig. Just read through that. I'm guessing my server is an MPP architecture which I gather isn't that expensive after all since 2 SMP machines together can become an MPP server. That said, is there any specific command to find out what the architecture is? At least I'm sure now that I wasn't...
by TonyInFrance
Fri Sep 16, 2016 3:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Duplicate entry issue - Lookup stage
Replies: 12
Views: 12995

Coming back to this and specifically to Klaus's post: Klaus... What you said is how I had understood the lookup stage functions - entire partitioning should NOT copy each line into each partition. However curiously enough in my setup that's exactly what's happening. I tested with a lookup containing...
by TonyInFrance
Fri Sep 09, 2016 1:25 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameter Set Import
Replies: 7
Views: 7713

It appears that our installation was causing this problem. I was told that as long as we had our XMETA DB on the same server as ous DS Engine there wasn't a problem. However of late we migrated our XMETA to a different physical server housing an oracle Database and ever since, after every project cr...
by TonyInFrance
Thu Sep 08, 2016 8:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameter Set Import
Replies: 7
Views: 7713

I don't think so since I import objects in other projects using the same user ID and I've done this kind of imports earlier. Further... I can't delete the project in Administrator as I get the message: Failed to delete all repository objects for project Serveurxxx/Projectxxx. This may be due to insu...
by TonyInFrance
Thu Sep 08, 2016 7:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Parameter Set Import
Replies: 7
Views: 7713

Parameter Set Import

Ladies and gentlemen I have another weird problem regarding parameter sets. I have this perfectly functional parameter set which I've exported as a DSX and am trying to import into a new project with the intention of changing the name since the parameters are global in nature and can be shared by mu...