The thing is I need to continue with the value from last job.
How can I implement it, very confused.
Somebody can paste a link for me ?
Search found 160 matches
- Tue Apr 10, 2007 8:01 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate sequence number in Parallel Job
- Replies: 8
- Views: 3194
- Tue Apr 10, 2007 6:18 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to generate sequence number in Parallel Job
- Replies: 8
- Views: 3194
How to generate sequence number in Parallel Job
I know there is a SDK API routine KeyMgtGetNextValue.
But it looks like illegal for parallel job, anybody can help ..
But it looks like illegal for parallel job, anybody can help ..
- Tue Apr 10, 2007 4:51 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: funnel Stage issue
- Replies: 9
- Views: 3877
- Tue Apr 10, 2007 9:11 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: funnel Stage issue
- Replies: 9
- Views: 3877
funnel Stage issue
I need to add one row head and one row tail to my output data file. And I use funnel to combine 3 different inputs. Input1 is the one row header, Input2 is the body of data file Input3 is the tail of the file. I use sequence mode for funnel. partition use default. I guess it is a partition problem, ...
- Tue Apr 10, 2007 8:41 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash table warning
- Replies: 3
- Views: 2504
- Mon Apr 09, 2007 5:27 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Hash table warning
- Replies: 3
- Views: 2504
Hash table warning
I got a new warning in my job log. It is
"Hash table has grown to 16384 entries."
"Hash table has grown to 32768 entries."
Anybody knows how to get rid of them ?
"Hash table has grown to 16384 entries."
"Hash table has grown to 32768 entries."
Anybody knows how to get rid of them ?
- Wed Apr 04, 2007 1:50 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: How to get rid of such a warning
- Replies: 1
- Views: 1664
How to get rid of such a warning
Join_AXIS_ADDR.CIDNAXISSRVC_Sort: When checking operator: Operator of type "APT_TSortOperator": will partition despite the preserve-partitioning flag on the data set on input port 0. Anyway can help, what option I need to choose to get rid of the warning, and guarantee the join result is s...
- Wed Apr 04, 2007 1:48 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
My case is like id1, id2 1, a 1, a 1, b 1, b 1, c 2, a 3, a 4, c I need to remove any id1 who has more than 2 different id2. It is a little bit tricky. What I did is remove duplicate based on id1, id2, hope to get id1,id2 1,a 1,b 1,c 2,a 3,a 4,c Then I use aggregator to count rows based on id1, hope...
- Tue Apr 03, 2007 7:56 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
Update about the problem, I am still working on it and finding some hints If i put a remove dupliate stage in front of aggregator, the output result is what i want ? And if I use aggregator stage inside unique option for the input stream, and the output of aggregator is not right, there is one row o...
- Tue Apr 03, 2007 5:19 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
I spend around 3 hours and use change capture stage and find the problem. I have some duplicate keys (actually only 1 row) in my right input , which is supposed to be unique. Two strange things. 1) I used remove duplicated stage on the right input, and it didn't remove out the duplicated one, but it...
- Tue Apr 03, 2007 7:19 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
- Tue Apr 03, 2007 7:18 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
- Tue Apr 03, 2007 2:32 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Strange problem about join stage
- Replies: 8
- Views: 2954
Strange problem about join stage
I got a very strange problem today from join stage. Use inner join left input, Dataset A has 5M rows, copy dataset A to aggregator, group by keya,( count rows, and I need to filter out some of them) Output to right dataset B, which has 830 rows, and I didn remove duplicate, still 830 rows. Inner joi...
- Fri Mar 30, 2007 1:09 am
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: What datatype to store the value of count rows in aggregator
- Replies: 1
- Views: 1407
What datatype to store the value of count rows in aggregator
I use aggregator to count rows, and count rows value is stored in a field callded countOfRows I assiged the datatype of countOfRows as integer, decimal, numeric, double, float, Datastage always pops up warning like "When binding output interface field "RecNO" to field "RecNO"...
- Mon Mar 26, 2007 11:35 pm
- Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
- Topic: Modify Stage and dataset view problems
- Replies: 1
- Views: 795
Modify Stage and dataset view problems
I want to use modify stage to transfer columna to columnaa by remove the last bit of columna, and convert to number, basically Columna like 6572888. varchar2 Columnaa should be 6572888 number. And i use Columnaa:decimal[10] = decimal_from_string(substring[0,10](Columna)) I guess my questions is whet...