Oracle Enterprise Load-Append - Not inserting in Parallel

Post questions here relative to DataStage Enterprise/PX Edition for such areas as Parallel job design, Parallel datasets, BuildOps, Wrappers, etc.

Moderators: chulett, rschirm, roy

Post Reply
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Oracle Enterprise Load-Append - Not inserting in Parallel

Post by mkiru23 »

Hi

I tried multiple options to use Enterprise Oracle load with append to do inserts in parallel.

1.OPTIONS(DIRECT=FALSE, PARALLEL=TRUE) with out rebuild index

2.OPTIONS(DIRECT=TRUE, PARALLEL=TRUE,SKIP_INDEX_MAINTENANCE=YES) with rebuild index

The table has unique index and range partition on date with 3 million rows on each date. I searched the forum too.

Control file :

OPTIONS(DIRECT=TRUE,PARALLEL=TRUE,SKIP_INDEX_MAINTENANCE=YES)
LOAD DATA length semantics byte INFILE 'ora.659462.895537.fifo.0' "FIX 973"
APPEND INTO TABLE daily_agg
(
.......

Please let me know if we can do inserts in parallel.

Thanks
Kumar
dsuser_cai
Premium Member
Premium Member
Posts: 151
Joined: Fri Feb 13, 2009 4:19 pm

Post by dsuser_cai »

try using upsert method. Insert/Update.
Thanks
Karthick
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

dsuser_cai wrote:try using upsert method. Insert/Update.
Thanks Karthick, This is also loading in sequential only ( 1 row at a time).
dsuser_cai
Premium Member
Premium Member
Posts: 151
Joined: Fri Feb 13, 2009 4:19 pm

Post by dsuser_cai »

Hi
did you try changing the execution mode to parallel.
Thanks
Karthick
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

dsuser_cai wrote:Hi
did you try changing the execution mode to parallel.
That's the default mode, I didn't change that. The explain plan in DB shows 1 row at a time.
keshav0307
Premium Member
Premium Member
Posts: 783
Joined: Mon Jan 16, 2006 10:17 pm
Location: Sydney, Australia

Post by keshav0307 »

how many nodes you have in configuration file?
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

Keshav,
8 nodes. please let me know if we can change/update the options to load/insert in parallel.
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

Is the table partitioned?
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

ray.wurlod wrote:Is the table partitioned?
Thanks Ray, yes it is range partition on date column with 6 months of data daily.

-Kumar
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

ray.wurlod wrote:Is the table partitioned?
Does any one has similar situation, how to achieve parallel inserts in oracle enterprise for range partitioned on date and unique index table.

Thanks
Kumar
sanjay
Premium Member
Premium Member
Posts: 203
Joined: Fri Apr 23, 2004 2:22 am

Post by sanjay »

Kumar

Please try

$APT_ORACLE_LOAD_OPTIONS=OPTIONS(SKIP_INDEX_MAINTENANCE = TRUE,bindsize=8250000,readsize=8250000,rows=2000)

u can can insert in parallel from datastage based on configuration file

Thanks
Sanjay
mkiru23 wrote:
ray.wurlod wrote:Is the table partitioned?
Does any one has similar situation, how to achieve parallel inserts in oracle enterprise for range partitioned on date and unique index table.

Thanks
Kumar
ray.wurlod
Participant
Posts: 54607
Joined: Wed Oct 23, 2002 10:52 pm
Location: Sydney, Australia
Contact:

Post by ray.wurlod »

The site where U is currently working does not use Oracle.

The second person personal pronoun in English is spelled "you", not "u". Please strive for a professional standard of written English on DSXchange, not least to assist those whose first language is not English.
IBM Software Services Group
Any contribution to this forum is my own opinion and does not necessarily reflect any position that IBM may hold.
mkiru23
Premium Member
Premium Member
Posts: 33
Joined: Thu Nov 20, 2003 4:33 pm
Location: SFL

Post by mkiru23 »

sanjay wrote:Kumar

Please try

$APT_ORACLE_LOAD_OPTIONS=OPTIONS(SKIP_INDEX_MAINTENANCE = TRUE,bindsize=8250000,readsize=8250000,rows=2000)

u can can insert in parallel from datastage based on configuration file

Thanks
Sanjay

Sanjay,

I tried the job with this change but no difference. I planned a workaround to break the job in one to create a file with SKG and load that file in parallel with parallel option.

Thanks
Kiran
devanars
Premium Member
Premium Member
Posts: 99
Joined: Thu Nov 30, 2006 6:25 pm

Post by devanars »

I am also trying to insert records in the oracle target which has index. Job is running such a long time with out any throughput. can any one provide help on this.
chulett
Charter Member
Charter Member
Posts: 43085
Joined: Tue Nov 12, 2002 4:34 pm
Location: Denver, CO

Post by chulett »

devanars - please start your own post.
-craig

"You can never have too many knives" -- Logan Nine Fingers
Post Reply