Search found 78 matches

by jusami25
Tue Oct 07, 2014 2:22 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving a large Join
Replies: 9
Views: 5999

Hi Ray, thanks for your reply.

The Netezza database doesn't have indexes, only distribution keys. BO is generating a job that contains a RowGenerator that executes a Netezza Stage with all the process included into the AFTER-SQL field.
by jusami25
Mon Oct 06, 2014 9:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving a large Join
Replies: 9
Views: 5999

Why? Cause i think the BO don't consider the partition options, only if we sort the input data in the stages, BO perform an ORDER BY clause in the optimized query. Analizing the optimized query, and the whole netezza stage itself, i cant see any reference to the partition options. I think that the ...
by jusami25
Mon Oct 06, 2014 4:33 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving a large Join
Replies: 9
Views: 5999

Yes, and i removed it to improve almost 3 minutes the join process.

Is it possible that executing a simple "SELECT * FROM TABLE1 left join SELECT * FROM TABLE2" between this two large tables is faster than the same operation using Balanced Optimization?
by jusami25
Thu Oct 02, 2014 1:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving a large Join
Replies: 9
Views: 5999

Improving a large Join

Hi guys! I have 2 Netezza stages with 500 Millions (left flow, with 200 columns) and 50 Millions of records (right flow, with 10 columns) each one. Then, I have a Left Join between that two flows, ending in a Netezza writing stage. I use the Balanced Optimization Tool to improve the performance in t...
by jusami25
Tue Jan 22, 2013 2:37 am
Forum: General
Topic: How to order Parameter Sets Values inside one Parameter Set?
Replies: 6
Views: 3419

OK, I've found why Datastage orders the parameters sets values in this way. As you may know, each value of the parameter set is stored in a different physical file. For example, in my case, for each value I have a different file inside the directory /ETL/Projects/R1B1/ParameterSets/HEADER_ETL_PARAMS...
by jusami25
Mon Jan 21, 2013 7:25 am
Forum: General
Topic: How to order Parameter Sets Values inside one Parameter Set?
Replies: 6
Views: 3419

Hi kduke, I've tried with both mouse button, and in combination with SHIFT, ALT and CONTROL keys, and no luck. Datastage seems to apply some kind of 'Hash' because if I insert a new value called 'TEST' it goes directly to the position 31. Then I change 'TEST' to something else, changes it position.....
by jusami25
Tue Jan 15, 2013 9:06 am
Forum: General
Topic: How to order Parameter Sets Values inside one Parameter Set?
Replies: 6
Views: 3419

How to order Parameter Sets Values inside one Parameter Set?

Hi all, I'll like to know if its possible to order the values of one parameter set. For example, if you look at this image, we have several values for the parameter set called HEADER_ETL_PARAMS http://img837.imageshack.us/img837/1264/65381894.png But the values are unsorted, even if we have entered ...
by jusami25
Tue Sep 25, 2012 7:42 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Fail trying to re-initialize a surrogate key value
Replies: 3
Views: 2763

Fail trying to re-initialize a surrogate key value

Hi all! Let me try to explain the problem we have... We are trying to generate surrogate keys in our architecture, consisting in different jobs that loads different tables. The client requirement is that the keys needs to be different in all the system, so all the jobs will share the same key genera...
by jusami25
Wed Jul 29, 2009 1:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Datastage MVS version to IIS v8.x
Replies: 3
Views: 2081

Datastage MVS version to IIS v8.x

Hi,

I'm looking options to migrate Datastage jobs developed for the Datastage MVS version to IIS v8.x.

There is any litereature that provided a road map to migrate the Datastage MVS jobs to IIS v8.x?

There is any toolthat would help to do the migration?

Thanks in advance.
by jusami25
Thu May 21, 2009 2:01 am
Forum: Information Analyzer (formerly ProfileStage)
Topic: Datastage Export from Commandline
Replies: 8
Views: 11907

Hi all,

we are having the same issue. WE want to find a way of create an export by using our automated command line script without including these Data Quallity specs. they are causing the export program to abort.

Any clue about that??


Thanks
Julio
by jusami25
Thu May 07, 2009 3:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Link keeps black
Replies: 15
Views: 6152

Hi, Following eostic workaround to add a copy stage between the dataset and the oracle stages now the link becomes green. I think remember that when datastage compiles a copy stage that is just mapping all the fields on the compiled code is like this copy stage doesn't exist. In case I'm right. Why ...
by jusami25
Wed May 06, 2009 10:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Link keeps black
Replies: 15
Views: 6152

APT_NO_JOB_MON = False
by jusami25
Wed May 06, 2009 10:03 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: compile jobs on a specific category
Replies: 7
Views: 4282

Hi all,

finally we created a script which reads the jobs names from a test file and compiles job by job.

Thanks for your suggestions.
by jusami25
Tue May 05, 2009 3:11 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: compile jobs on a specific category
Replies: 7
Views: 4282

Thanks Sun and Sainath for you replies.

We know the existence of the multiple-job compile tool, but we need to do it using an scheduled script and because of this we use the dscc command.

Any suggestion about how to do it using the command?

regards