Search found 165 matches

by vnspn
Mon Dec 21, 2009 12:05 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inconsistent View Data in Sequential File stage
Replies: 9
Views: 3502

Ray - I have my sampling specfication with the highest value possible, '9999'. chulett - You have precisely stated our scenario. When we repeatedly view the exact same static data over and over using the same settings, the results are not identical. We shall get in touch with our vendor support as y...
by vnspn
Thu Dec 17, 2009 4:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inconsistent View Data in Sequential File stage
Replies: 9
Views: 3502

The datatype is Interger.
I'm not getting any error /warning message when I view data. But, it just misses some records...
by vnspn
Thu Dec 17, 2009 1:51 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inconsistent View Data in Sequential File stage
Replies: 9
Views: 3502

No, they are not skipped. So far when we have run the job, I see them in the output. The problem is only when I view the data from the stage. Because it sometimes shows up and sometimes does not with view data, we are worried that, if that would drop those records during some runs.
by vnspn
Thu Dec 17, 2009 9:39 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inconsistent View Data in Sequential File stage
Replies: 9
Views: 3502

Re: Inconsistent View Data in Sequential File stage

I'm doing nothing differently.

I just repeatedly do a view data, and at times is shows all records and at certain times does not show the last few records with -1.
by vnspn
Thu Dec 17, 2009 8:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Inconsistent View Data in Sequential File stage
Replies: 9
Views: 3502

Inconsistent View Data in Sequential File stage

Hi, We have a Sequential File stage as source that reads a .csv file. This file has 115 records in it. The last few records have a value of -1 in one of the columns. When we do a view data on this stage, the number of records that show on the screen are inconsistent. Sometimes it shows all records i...
by vnspn
Tue Mar 31, 2009 12:24 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abort After Rows - Write to Sequential File Not working
Replies: 7
Views: 5774

Thanks for all your response. Our requirement was to make both of these happen. 1) Abort the job immediately if an invalid value comes through. 2) Capture just the one record (first record) value that passed through the abort condition. We were able to achieve this at the end. Initially the output e...
by vnspn
Mon Mar 30, 2009 9:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Abort After Rows - Write to Sequential File Not working
Replies: 7
Views: 5774

Abort After Rows - Write to Sequential File Not working

Hi, We have a job where we want to abort the job when we get some invalid values for a column. We handle this using the "Abort After Rows" option in the Transformer. The output of that link is sent to a Sequential File stage to capture the invalid value. The limit is set as '1'. When we ru...
by vnspn
Fri Sep 12, 2008 8:46 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup in a Grid environment
Replies: 6
Views: 2725

lstsaur, no, the job log did not show entries from the link where reference data is fetched. Infact we are using a join stage for fetching the reference data and not a lookup stage.

ray, we did not try using Entire partition. Will check that and see what happens...
by vnspn
Thu Sep 11, 2008 7:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup in a Grid environment
Replies: 6
Views: 2725

lstsaur, I checked the log and it does not show this information. The reference table has 5 records and I see the same count that shows on the link using performance statistics. I'm sure the records are not being dropped. ray, the partitioning algorithm on the reference link is Hash partition on the...
by vnspn
Wed Sep 10, 2008 7:14 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Lookup in a Grid environment
Replies: 6
Views: 2725

Lookup in a Grid environment

Hi, We are working in a DataStage Grid environment with multiple compute nodes. We came across a situation that worked unexpectedly. We run a job using 2 compute nodes and 2 partitions each. The job works as expected. The lookup to an Oracle table fetches correct reference data. When we run the same...
by vnspn
Tue May 20, 2008 10:51 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Email body - send hyperlink with spaces inbetween
Replies: 1
Views: 1414

Email body - send hyperlink with spaces inbetween

Hi, We have a requirement to pass a windows shared folder link in the email body of the Notification Activity. This shared folder link has spaces inbetween in the folder names. When we give this as folder link name in the email body, the complete folder link does not come as hyperlink in the email s...
by vnspn
Tue May 20, 2008 9:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Notification Activity - Email body
Replies: 1
Views: 1429

Notification Activity - Email body

Hi, In the Email Notification stage, we are trying to provide an output filename in the email body. This file is created by a previous job. So, we have to dynamically obtain the name of that file and put it in the email body. We tried to get the filename using a routine and then provide it in the em...
by vnspn
Mon May 19, 2008 10:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File nane with date
Replies: 25
Views: 14060

Thanks a lot Craig.

I did it the way you said in After-job ExecSH. It worked.

Thank you...
by vnspn
Mon May 19, 2008 9:48 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File nane with date
Replies: 25
Views: 14060

Thanks Craig.

I changed it to 'back tick' and ran and still its not working. I tried creating the file using this through command line and that worked. But when I give this expression within the stage in DS, it does not work. Any idea...
by vnspn
Mon May 19, 2008 8:35 am
Forum: IBM<sup>®</sup> Infosphere DataStage Server Edition
Topic: File nane with date
Replies: 25
Views: 14060

If your concern with the Unix option is that you don't want another 'asset' to have to manage outside the DataStage environment then couldn't you just supply the 'script' in the filename specification? E.g. Something like ... MyFilename_`date +%Y%m%d-%H%M%S`.txt I've been working in a purely PX env...