DSXchange

Hi ,

Facing an error "Array Index out of Range:32" When i try to perform column analysis.

Please advice to fix it.

Paul, it runs on 4 nodes and records are equally distributed.

ssnegi, I will try to see the performance of the table, I bit concern about IO operations between APP server and DB server to carry these big records....

We need some how data should be single dataset to prepare hierarchives and pass it to further level...

Andy, I have followed already Ray steps and its confirmed that it is issue with dataset.

Dataset size : around 1 GB

Ray, it is issue with dataset only I tried as you adviced...

chulett wrote:What kind of suggestions are you looking for?

Data volume will increase day by day, Is there any optimized ways when dealing with bigger dataset. Also I am going to deal with many bigger datasets soon.

Thanks in Advance...

Datatypes are bounded length and a maximum of 150 characters.
Version is: Datastage 8.5
Both Jobs run on 4 nodes
Here is data management stats...

Total Records: 176618
Total 32K Blocks: 7360
Total Bytes: 942998906

Hi, We have a job, Source (Dataset) --> CopyStage --> Database (Oracle Connector) Dataset contains 500 columns and 200,000 records. The reading from dataset is very slow so that is the reason i have added APT_DEFAULT_TRANSPORT_BLOCK_SIZE and APT_MAXIMUM_TRANSPORT_BLOCK_SIZE parameter to increase per...

Try to enable reject link and capture the record.

What is the current value for Surrogate key.

So, by default it will take Session parameteres. If we want to change then we need to apply alter command.

Noted. Thanks :D

Hi,

I don't see any NLS setting option for Oracle connector. How to change NLS setting for Connector.

Hi, We are in development phase. When i had cross checked between Source and Target environment this some vary in NLS settings. Source:OLTP Oracle : AMERICAS - UTF8 Target :DW Oracle : AMERICAS - AL32UTF8 Datastage NLS Setting: ISO-8859-1 Suppose if any multibyte characters come source whether this ...

Yes, we can take max value even for file also. It is at Initial value.