Search found 78 matches

by dj
Mon Sep 08, 2014 4:20 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Connector as a target stage/re-processing on job failure
Replies: 5
Views: 2916

Thank you Prasson and Mike for your inputs. Discussed with the downstream consumers about re-sending the messages again and concluded to implement the logic on their side(similar to the logic as per prasson_ibm) to not re-process the previously sent messages. So, there was no change to the datastage...
by dj
Thu Aug 21, 2014 11:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Connector as a target stage/re-processing on job failure
Replies: 5
Views: 2916

My job design is as shown below db2_connector --> XFM --> XML_Output --> MQ_Connector I am picking the required records from a table in DB2, creating a required XML(sequentially) for each record and sending them on to the cluster queue. I am using the default config file while running the job and wi...
by dj
Wed Aug 20, 2014 12:53 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: MQ Connector as a target stage/re-processing on job failure
Replies: 5
Views: 2916

MQ Connector as a target stage/re-processing on job failure

I am new to websphere MQ connector stage :( . I am trying to understand how does the MQ connector stage can prevent sending the same messages to the queue in the event the job failed after processing few messages and then i re-run the job again. is there a setting i can use in the connector stage or...
by dj
Mon Jan 28, 2013 9:47 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Is fork Join not preferable?
Replies: 2
Views: 2816

Is fork Join not preferable?

Hi All, There is a requirment, where i should pass only the unique records to the lookup and then do a join back on the source to pick the other columns. This obvioulsy becomes a fork-join kind. but i was not sure if this would become any deadlock, as the join stage should wait for the entire lookup...
by dj
Sun Nov 25, 2012 12:39 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Does Vertical Pivot can restrict rows
Replies: 2
Views: 1255

Does Vertical Pivot can restrict rows

Hi All, Can vertical Pivot stage can restrict rows for the defined array size? i/p seq_num value 1 a 1 b 1 c 1 c2 2 d 2 e 3 f Arraysize =2. I need to only generate 2 pivot columns o/p seq_num value_1 value_2 1 a b 2 d e 3 f Does pivot ignores the remaning rows for seq_num=1. In general, irrespective...
by dj
Sun Nov 25, 2012 10:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counter value in Grid Partition
Replies: 9
Views: 2452

In the transformer i have set it as sequential for generating the counter. In Peek , it is set by Default (Parallel). when there are 60rows for accttype ,the peekstage doesn't capture all the 50rows. AcctType Counter A1 1 A1 2 A1 26 A1 50 B1 3 B1 50 The input is Hash partitioned and sort on AcctType...
by dj
Sun Nov 25, 2012 7:17 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counter value in Grid Partition
Replies: 9
Views: 2452

The output from the transformer for each account type should restrict for 50rows. Input to transformer is SOrted on Accttype stagevar details: Currval: AcctType Counter : If CurrVal=PreVal then Counter+1 Else 1 PreVal:Currval Constraint: Counter<=50 Output From Transfomer; peekstage: AcctType Counte...
by dj
Sat Nov 24, 2012 3:35 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Counter value in Grid Partition
Replies: 9
Views: 2452

Counter value in Grid Partition

Hi All, Iam Currently using Datastage 8.5 Version. I have created a counter stage variable in transformer (whichis set in sequential mode) My requirment is I need to Process the records when the counter <=50 Only the 50 records for each Accounttype. Counter: If CurrentAccounttype=PrevAcctype then co...
by dj
Fri Aug 03, 2012 6:13 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NUMBER/ Decimal Metadata Conversion
Replies: 5
Views: 2785

Thanks Ernie, Iam Marking this post as resolved.

-dj
by dj
Wed Aug 01, 2012 6:57 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: SIGABRT Job Aborts
Replies: 1
Views: 2398

SIGABRT Job Aborts

Hi All, The Job that is reading from a dataset and loading into SAP through BAPI Stage fails with the below error. TGTBAPI:Operator terminated abnormally: received signal SIGABRT TGTBAPI:Operator terminated abnormally: received signal SIGSEGV. Total rows is ~ 25Million and Exactly at the 10M job abo...
by dj
Wed Aug 01, 2012 1:59 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NUMBER/ Decimal Metadata Conversion
Replies: 5
Views: 2785

Thanks Chulett and Ernie

Using Oracle connector import wizard ,all the NUMBER datatypes have been imported as DOUBLE.

Since its double, the values are with the scale range 1623.567 .

Thanks,
dj
by dj
Tue Jul 31, 2012 6:36 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: NUMBER/ Decimal Metadata Conversion
Replies: 5
Views: 2785

NUMBER/ Decimal Metadata Conversion

Hi All, While I do a metadata import through plug-in for an Oracle table, the Column1 Number type is imported as Column1 Decimal(32). The pbm is that in source the Column1 holds values like 1623.567 but in the datastage since there are no scale , i get only 1623. The values without scale,affects the...
by dj
Thu Apr 19, 2012 2:52 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Join stage performance
Replies: 2
Views: 1522

Join stage performance

Hi Gurus , Job: derives the max id from the reference text file and generates sequences and current max seq valueis written to text file. input dataset :10000 rows reference file : It always hold the MAX ID :1row. dummy_key MAX_ID(BigInt) 'X' 43428000032 using a dummy key ,Join stage is used to deri...
by dj
Sat Dec 22, 2007 11:17 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Job Sequencer
Replies: 1
Views: 1323

Job Sequencer

Hi, I just want to do the following seq of jobs. job A--->job B---> Job c----->Job D | | | Job A1--->Job B1--> Job c1--> Job D1 Job B1 should start only after completion of both job A1 and Job b. can any one suggest me by using what stage i will able to validate this condition. thanks in advance - dj
by dj
Thu Dec 13, 2007 1:59 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: Sequencer Compilation error
Replies: 3
Views: 1338

Sequencer Compilation error

Hi, iam just trying to compile the sequencer after renaming.but the following error appears. i have a seq A. i have made copy of seq A. deleted A and tried to rename copy seq to A. pls clarify <JobSeqGenError> <Code>2017</Code> <Desc>XML parser error on input line 0: source='', reason='The system ca...