Factors to decide the run mode of Oracle connector
Posted: Mon Apr 08, 2019 12:48 pm
Hi,
We are doing performance testing
We are reading data from an oracle table in the oracle connector stage.
The query used is
select col1,col2,col3
from table1
where col2='Z'
The query returns 50 million records.
We are reading data from another oracle table
select col1,col2,col3
from table2
where col2='1'
The query returns 41 million records.
We are joining the data returned from these two tables using join stage.
We are doing performance testing.
For extracting data from table1,when we set the option "Enable Partitioned reads" to No, the stage runs on one node and the time taken to read is around 2 min.
But When we set the option "Enable Partitioned reads" to Yes, the stage runs on multiple nodes(we are using 10 node config file) and the time taken to read is around 10 min.
The table is not partitioned in the db.
For extracting data from table2, the "Enable Partitioned reads" to Yes fetches the data faster. Elapsed time is 30 sec.
What are the factors to be considered to set the "Enable Partitioned reads" to Yes or No?
We are doing performance testing
We are reading data from an oracle table in the oracle connector stage.
The query used is
select col1,col2,col3
from table1
where col2='Z'
The query returns 50 million records.
We are reading data from another oracle table
select col1,col2,col3
from table2
where col2='1'
The query returns 41 million records.
We are joining the data returned from these two tables using join stage.
We are doing performance testing.
For extracting data from table1,when we set the option "Enable Partitioned reads" to No, the stage runs on one node and the time taken to read is around 2 min.
But When we set the option "Enable Partitioned reads" to Yes, the stage runs on multiple nodes(we are using 10 node config file) and the time taken to read is around 10 min.
The table is not partitioned in the db.
For extracting data from table2, the "Enable Partitioned reads" to Yes fetches the data faster. Elapsed time is 30 sec.
What are the factors to be considered to set the "Enable Partitioned reads" to Yes or No?