Search found 14 matches

by prematram
Sat Mar 17, 2018 9:34 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: BigIntegrate in Hadoop - Dataset stage vs BDFS stage
Replies: 2
Views: 3105

BigIntegrate in Hadoop - Dataset stage vs BDFS stage

Hi, We are currently using dataset stage for creating intermediate files in HDFS. The descriptor file is created on the edge node (Linux) and data files resides on the data nodes (HDFS). My questions are: 1) Do we have any I/O performance overhead since descriptor is not in HDFS and data files are i...
by prematram
Mon Sep 08, 2008 7:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A scenario in lookup stage
Replies: 4
Views: 2207

RE:

Thanks to all....

Prasson...i think when we put it as numeric type,it wont take leading zeros..i tried that solution..its working... r u sure prasson...??
by prematram
Mon Sep 08, 2008 3:26 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: A scenario in lookup stage
Replies: 4
Views: 2207

A scenario in lookup stage

Hi, In lookup stage,i used varchar column - MEM_ID as key column. The values of this column MEM_ID in main file and ref file is as follows. MEM_ID - varchar2(5) Main File: ======= MEM_ID MEM_NAME 1 prem 2 surendar Ref File ===== MEM_ID COV_ID 01 100 02 200 What would be the result..?? does the key c...
by prematram
Tue May 13, 2008 6:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup - different scenario
Replies: 7
Views: 2801

Lookup - different scenario

Hi, i need solution for the following scenario: i am having one main file and reference file. I need to lookup data based on specific value which may be in any column, not based on specific column... ie in lookup stage what happens is we give a key column with which matched records w.r.t that column...
by prematram
Wed Apr 09, 2008 7:11 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: User inserted sort...
Replies: 5
Views: 4124

Still having one doubt

Hi,

Thanks for your response.

But same job when i tried running with config referring 4 nodes, it hasa run successfully. But the problem araised only when we tried running with config file pointing to 8 nodes.

The prevailing problem is anyway related to that...??
by prematram
Wed Apr 09, 2008 4:31 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: User inserted sort...
Replies: 5
Views: 4124

User inserted sort...

I used a sort stage with hash partionning and after sorting the data , i used remove duplicates stage with same partition. I am encountering the error as "User inserted sort "LabResultMem_srt" does not fulfill the sort requirements of the downstream operator "LabResultMem_rdup&qu...
by prematram
Wed Mar 19, 2008 3:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: main_program: The section leader on apsp8507 died
Replies: 2
Views: 3707

main_program: The section leader on apsp8507 died

When itry to run a job which loads data into DB2 database from sequential file, i encountered the following error :

"main_program: The section leader on apsp8507 died"

what is this...? any solutions...??
by prematram
Fri Feb 29, 2008 6:34 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stopped but status is showing as running
Replies: 1
Views: 1101

Stopped but status is showing as running

In the director it is showing job status as "Running" for a particular job. But when i tried to monitor that job,it is showing as 'stopped' status in monitor window.... why does this happens....??? if someone have stopped that job...?? it should show aborted status... also chked that job.....
by prematram
Fri Feb 29, 2008 6:15 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stage type BBB being accessed by another user
Replies: 3
Views: 1638

I got the error when i tried to monitor the particular job first and then again came when i tried view log details. But it came only once..i dont know why it has come....
by prematram
Fri Feb 29, 2008 5:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Stage type BBB being accessed by another user
Replies: 3
Views: 1638

Stage type BBB being accessed by another user

Following error is coming when trying to view log for a particular job in Datastage director

"Stage Type BBB is being accessed by another user"

When and why does this error comes...??
by prematram
Thu Dec 20, 2007 5:07 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: DSLinkRowcount
Replies: 1
Views: 3228

DSLinkRowcount

Hi,

What is the functionality of DSLinkRowcount...?

plz provide the equivalent of DSLinkRowcount macro in parallel..??
by prematram
Wed Dec 19, 2007 5:55 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: difference between lookup, join and merge in datastage
Replies: 2
Views: 5708

difference between lookup, join and merge in datastage

Hi,
What is the difference between lookup, join and merge in datastage...??...which is more efficient....??
by prematram
Mon Dec 17, 2007 1:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Alternative to @INROWNUM system variable
Replies: 3
Views: 2484

Alternative to @INROWNUM system variable

Hi,

Is bthere any altertnative to @INROWNUM system variable in parallel extender..bcoz it is not working in parallel.. what is the use of @PARTITIONNUM..?/
by prematram
Fri Dec 14, 2007 4:40 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Which is beeter ? Lookup File set or Dataset or Fileset
Replies: 1
Views: 1163

Which is beeter ? Lookup File set or Dataset or Fileset

Hi,
Which file is better.....Lookup File set or Dataset or Fileset and when these each one is getting used to get efficient result ...??