Search found 49 matches

by akarsh
Wed Feb 25, 2015 9:11 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: xml stage JVM issue
Replies: 0
Views: 1295

xml stage JVM issue

Hi, I am reading a xml file using xml stage and getting below waring and error XML_Validate,0: JVMDUMP006I Processing dump event "systhrow", detail "java/lang/OutOfMemoryError" - please wait. XML_Validate,0: JVMDUMP032I JVM requested Heap dump using I kept the heap size as 512MB ...
by akarsh
Tue Feb 24, 2015 8:32 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Job run with XML stage
Replies: 2
Views: 2956

Hi Chulett,

My job is running fine now but when calling through seq its giving same issue. Please suggest what needs to be done.

Thanks,
Akarsh
by akarsh
Tue Feb 17, 2015 2:31 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Time-out Error with XML stage in DataStage 8.5
Replies: 4
Views: 3955

Re: Time-out Error with XML stage in DataStage 8.5

Hi,

Faced the same issue. Just restarted the seq and it's ran well.
by akarsh
Wed Feb 11, 2015 4:35 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Issue with Job run with XML stage
Replies: 2
Views: 2956

Issue with Job run with XML stage

Hi, I have a job with xml stage as source. Job is running fine but when running from seq its giving below error main_program: Syntax error: Error in "pxbridge" operator: Error in input redirection: Expected input name, got: "?", line 11; text: <? earlier was running seq with id1 ...
by akarsh
Mon Feb 09, 2015 10:55 am
Forum: General
Topic: Execute command activity output is not working
Replies: 3
Views: 3524

Hi Chulett, your reply worked :D I gave like this in execute command ls -lrt /path/*RATEE*.xml | wc -l > /dev/null Trigger condition File Missing Trim(ExecFileCheck.$CommandOutput,@FM) <> '' File Present Trim(ExecFileCheck.$CommandOutput,@FM) = '' Above Trigger condition gave correct output, Not sur...
by akarsh
Mon Feb 09, 2015 3:45 am
Forum: General
Topic: Execute command activity output is not working
Replies: 3
Views: 3524

Execute command activity output is not working

Hi, I have seen many post but still not working for me. I just need to see if file is not present in directory need not to run job and send mail. I am checking as below In seq in execute command actvity ls -lrt /Path/*ABC*.xml | wc -l in trigger section am checking like this for no file Trim(ExecFil...
by akarsh
Tue Apr 08, 2014 1:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: how to get max performance using upsert mode?
Replies: 4
Views: 2379

Re: how to get max performance using upsert mode?

Hi Sura,

Did you found the resolution.

I am also facing the same issue in insert then update job.
by akarsh
Fri Mar 14, 2014 9:41 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance of Join of Data Sets
Replies: 3
Views: 2687

Hi thompsonp, I am just having join the the job. and its same partition in join. speed is 1400-1600 row/ sec. Also have changed the buffer at join and kept it 6 MB. i/p Meta Data is around 500 bytes and out around 1000 bytes as am having full outer join in the job. earlier it was delete then insert ...
by akarsh
Fri Mar 14, 2014 1:44 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improve performance of Join of Data Sets
Replies: 3
Views: 2687

Improve performance of Join of Data Sets

Hi All, Even i am also facing the same issue as seen in this post. I have two data set as input to join stage and its extracting only 276 row/sec. below are the details Data Set 1 ----------- Total Records: 19199366 Total 32k Blocks: 19141 Total Bytes: 2430032178 Node Records blocks Bytes Node1 9593...
by akarsh
Mon Mar 10, 2014 2:58 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving performance of deletes
Replies: 9
Views: 5040

Hi Chulett,

We updated the job to remove deadlock issue by running DRS connector in seq mode and it took close to 12 hr to finish, which is not expected.

Please suggest if any change we can do now?
by akarsh
Sun Mar 09, 2014 1:18 pm
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving performance of deletes
Replies: 9
Views: 5040

Re: Improving performance of deletes

Hi All, I am back with the same issue :( . Now job is giving deadlock issue. Let me give details Ds -> Tfm -> DRS connector Ds has single field, on which data is hash partitioned and index is present in table on same field(this field is part of composite key, so composite index is present). In DRS c...
by akarsh
Fri Feb 21, 2014 5:12 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving performance of deletes
Replies: 9
Views: 5040

Improving performance of deletes

Thanks chulett for deleting multiple post. :D
Even was not able to find how come multiple post i made :)

Well yes table is indexed on field one, and am trying to run using DRS connector in place of oracle connector. will update you if any thing positive as so far facing space issue in DB.
by akarsh
Wed Feb 19, 2014 6:49 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Improving performance of deletes
Replies: 9
Views: 5040

Improving performance of deletes

Hi All, I am facing the same issue as seen here. I have 3.7L record in file which i need to delete from table which contains 90M.I Am using below query DELETE FROM Table WHERE Field1 = ORCHESTRATE.Field1 Design is simple DS -> Tfm -> Oracle connector in designer till connector data is moving as 8779...
by akarsh
Mon Feb 17, 2014 7:43 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running Oracle connector in parallel mode
Replies: 13
Views: 10266

Thanks BOB :D
In oracle was checking in diff schema :D
Finally Job took only 3.35 Mins, Below are the settings

Transaction Settings

Record Count - 40000
Mark End of wave - Yes

Session Settings

Array Size - 40000
PreFetch Row Count - 40000
PreFetch Buffer - 4096
by akarsh
Mon Feb 17, 2014 7:05 am
Forum: IBM<sup>®</sup> DataStage Enterprise Edition (Formerly Parallel Extender/PX)
Topic: Running Oracle connector in parallel mode
Replies: 13
Views: 10266

Re: Running Oracle connector in parallel mode

Hi BOB, I added DISTINCT in query and also changed some settings as below Array Size - 40000 PreFetch Row Count - 40000 PreFetch Buffer - 4096 Now job is taking just 4.5 mins, but results are not matching In DS select DISTINCT Field1 from Table giving o/p as 573684 records In Oracle DB select DISTIN...