Search found 15603 matches

by ArndW
Wed Mar 12, 2008 10:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Value file of parameter set
Replies: 1
Views: 779

I think it better to get the value dynamically in a job sequence and then pass that value as a parameter into the job.
by ArndW
Wed Mar 12, 2008 6:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Unable to trigger the datastage job through Unix
Replies: 2
Views: 1028

What is the Shell script "dsjob" command?
by ArndW
Wed Mar 12, 2008 6:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Regarding the residense of log files in datastage.
Replies: 13
Views: 5414

Please surround your program with code tags to make it legible. You are calling this as an after-job subroutine from the job itself, so I doubt that the end timestamp contians a value. Put calls to "DSLogInfo()" in your program in order to debug which path it takes and why nothing appears in your ou...
by ArndW
Wed Mar 12, 2008 6:53 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: SEQUENCE GENERATOR???????
Replies: 3
Views: 1308

The Routines\sdk has routines in the "KeyMgt" category that allow you to do this.
by ArndW
Wed Mar 12, 2008 6:52 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorted Hashed Partition in DataSet
Replies: 6
Views: 1453

If you have the "same" partitioning, then a join will only go between like partitions; in most cases the data isn't formatted that way and it will lead to data loss during joins. An easy test is to run the same job with a 1-node and an n-node configuration and compare the outputs, if they are not id...
by ArndW
Wed Mar 12, 2008 6:49 am
Forum: General
Topic: USE FUNCTIONS LIKE DateFromDaysSince() IN PARALLEL ROUTINES?
Replies: 9
Views: 2614

The transform stage c++ programs are hidden in the repository but they unfortunately don't contain any headers.
by ArndW
Wed Mar 12, 2008 6:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Sorted Hashed Partition in DataSet
Replies: 6
Views: 1453

Yes, it will keep the same partitions - but you need to ensure that a join on Group 1 from DataSet 1 doesn't link to a value in Group 2 on another DataSet.
by ArndW
Wed Mar 12, 2008 6:28 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: warning- Query returns no rows
Replies: 10
Views: 4191

right-mouse click on the warning message in the director, then choose "Add rule to message handler" and continue from there.
by ArndW
Wed Mar 12, 2008 6:24 am
Forum: General
Topic: USE FUNCTIONS LIKE DateFromDaysSince() IN PARALLEL ROUTINES?
Replies: 9
Views: 2614

Hello Saraswati and welcome to DSXchange. Yes, there are header files you need to include. The Advanced Parallel Developer's Guide has a chapter on the API. The file you need to include for DS function definitions is the $DSHOME/include/dsapi.h Now that I tried it I realized that the PX function def...
by ArndW
Wed Mar 12, 2008 5:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: percent_rank() function in Datastage
Replies: 11
Views: 6382

To complete the design - put in a transform stage that keeps a running total and compute the percentage rank there.
by ArndW
Wed Mar 12, 2008 4:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: How to extract data from VSAM file using CFF stage
Replies: 9
Views: 3070

Pradkumar - I don't know which mainframe character set you have, so I just chose one at semi-random. Use any EBCDIC character set to test.
by ArndW
Wed Mar 12, 2008 4:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicates -Rejected Records
Replies: 6
Views: 2358

Nirmala84 - the same method of using stage variables applies.
by ArndW
Wed Mar 12, 2008 4:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Surrogate key stage with source type as DB Sequence
Replies: 6
Views: 3589

Did you specify a block size of 1? Do you use a surrogate key stage in your job flow to actually generate keys?
by ArndW
Wed Mar 12, 2008 4:48 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Finding the number of leading zeros
Replies: 5
Views: 1380

I'd use the LEN() function as well. You know how long the numeric column is, when you convert from number to string and use LEN() and LEFT() functions to parse your result.
by ArndW
Wed Mar 12, 2008 4:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Remove Duplicates -Rejected Records
Replies: 6
Views: 2358

Sort the data on your key field, then use a transform stage that stores the last record key value in a stage variable and use the stage constraints to output records accordingly