Search found 120 matches

by highpoint
Mon Dec 17, 2012 4:46 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: To create XML data which stages to use.
Replies: 1
Views: 1299

To create XML data which stages to use.

Hi, I have to load a flat file which has 4 key columns and around 50 data columns. I would like to load this into a table that has 4 key columns and one xml column. I would like to load all the 50 columns data in to this single xml column. For doing that when I see IBM documentation I see 2 pdfs one...
by highpoint
Wed Sep 05, 2012 7:10 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Help understand wierd behaviour of Aggregator.
Replies: 1
Views: 1738

Help understand wierd behaviour of Aggregator.

I had problem with aggregator stages which were giving almost all column values as zero except for few records. I was able to resolve the issue by changing partitioning but still i don't understand what caused the issue in first place. Job Design for section of Interest. Remove Duplicate Aggregator ...
by highpoint
Mon May 21, 2012 8:36 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Best way to design load process
Replies: 4
Views: 2328

Best way to design load process

Hi, We normally load, load ready files into db2 using db2 connector.Normally our files are around 10 million records. If the load process fails say after 5 million records.Then we have to manually delete it using dba help. Dba takes long time to delete since he has to break into smaller sqls so that...
by highpoint
Wed Mar 14, 2012 3:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Reading multiple files using sequential file or other stage
Replies: 7
Views: 3242

Reading multiple files using sequential file or other stage

Hi, I have a file which will have list of files that i need to read. All this files will be in same directory and but non similar names. How could i make this read these files using sequential file stage or any other stage. Say My main file is: Filelist.txt. It contains following data input1.txt hou...
by highpoint
Fri Jan 20, 2012 8:18 pm
Forum: General
Topic: Problem with viewing DataStage logs in Unix
Replies: 12
Views: 8710

So it seems you may have found this post if you know about skipping Domain authentication. Did you read their resolution and try to verify that your permissions "all the way down" are correct? I read the post you pointed to and all the posts that post i pointing to. I have 2 questions. Qu...
by highpoint
Fri Jan 20, 2012 4:29 pm
Forum: General
Topic: Problem with viewing DataStage logs in Unix
Replies: 12
Views: 8710

Doesn't work either.

Code: Select all

$ dsjob -domain NONE -user ABC -password XXX -server dsserver:9080 -lprojects
Status code = 81005
by highpoint
Fri Jan 20, 2012 1:57 pm
Forum: General
Topic: Problem with viewing DataStage logs in Unix
Replies: 12
Views: 8710

PaulVL wrote:try the -lprojects first to see the proper spelling.
I tried it. I am getting following error.

Code: Select all

$ dsjob -lprojects
Status code = 39202
Help is appreciated.
by highpoint
Fri Jan 20, 2012 12:06 pm
Forum: General
Topic: Problem with viewing DataStage logs in Unix
Replies: 12
Views: 8710

Problem with viewing DataStage logs in Unix

Hi, I am trying to view log through unix and tried following command: $ dsjob -logsum Development ins_loans_table ERROR: Failed to open project Status code = 81005 Then i tried $ dsjob -domain NONE -user ABC -password XXXX-server dsserver:9080 -logsum Development ins_loans_table ERROR: Failed to ope...
by highpoint
Thu Jan 12, 2012 11:58 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wierd behavior of StringToDate conversion depending
Replies: 8
Views: 5168

If svOrderDate is char[8]. '20100301' is a char. Then do i have to convert them to decimal or integer before comparing them svOrderDate < '20100301' And say svShipDate is char[8] and svCancelDate is Char[8]. And if i have to compare svShipDate and svCancelDate then do i have to convert them first in...
by highpoint
Thu Jan 12, 2012 8:47 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wierd behavior of StringToDate conversion depending
Replies: 8
Views: 5168

First question would have to be why are you converting a string to a date and then comparing it to a string? Does svOrderDate include a time portion? Or maybe including dashes between fields? In this am i not comparing Date with a date? StringToDate(svOrderDate,"%yyyy%mm%dd") < '2010-03-0...
by highpoint
Thu Jan 12, 2012 6:49 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Wierd behavior of StringToDate conversion depending
Replies: 8
Views: 5168

Wierd behavior of StringToDate conversion depending

Wierd behavior of StringToDate conversion depending on location in If statement. If IsNotNull(ORCL.ORDER_DATE) and svOrderDate<>'' and StringToDate(svOrderDate,"%yyyy%mm%dd") < '2010-03-01' Then 'ABC' Else 'DEF' In this case the job throws warning as follows: Copy_of_Transformer_77,0: Conv...
by highpoint
Thu Jan 12, 2012 6:29 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: StringToDate on an empty string
Replies: 5
Views: 3211

StringToDate on an empty string

The datastage job i am developing deals mostly with date columns. The source columns are a char [8] fields. These fields stores dates in format 20100101 i.e. yyyymmdd The job should should be able to handle all kind of junk data. so when ever i am hitting null or invalid date in this field i make it...
by highpoint
Thu Oct 13, 2011 11:03 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delimiter for Sequential file with pipe & comma in data
Replies: 14
Views: 10906

I have tried using 025, 222 for all this it fails with the following error: DST_BenefitPlanLoad_MBR_PAY_DSGN_STEP_SUM_DIM_ins: Error when checking operator: "delim_string" property must have a string value; text: delim_string=222 When i use char(222) or @FM then the job runs fine but the d...
by highpoint
Wed Oct 12, 2011 10:17 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Delimiter for Sequential file with pipe & comma in data
Replies: 14
Views: 10906

Would appreciate reply on my question.

Looks like my thread is being hijacked. :D
by highpoint
Wed Oct 12, 2011 9:41 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Partitioning & Sort
Replies: 6
Views: 4069

Re: Partitioning & Sort

I am clear about the partitioning. My question was more towards the sort on each partition.

Will these stages maintain same sort order in output as input per partition.