DSXchange

Thanks for the response, i have just completed the run for loading data from a sequential file to a Oracle table which was a Plain Insert .. took 1 hour 13 minutes to complete

this job was a plain load ..read from Sequential stage and write to Oracle Stage

Hi All I have got a performance issue while reading a .csv file which has 10254768 rows of data in it. :shock: the job flow is as below Seq file >Transformer > Sort > Transformer > Oracle Stage ( 2 oracle stages ... one for capturing reject data and the other for good data) Our process runs on two n...

Thanks all for your response. I was finally able to fix the issue :lol: This job was changed couple of weeks back and the code has been stable,till we encountered this issue. The last modification on our code was to read a Nullable column and set it to default when we have no value If IsNull(Columnn...

I still get the same error. any other options?

Hi I have a job which was working good till yesterday. the job now fails with the below fatal errors buffer(2),1: Error in writeBlock - could not write 130080 buffer(3),1: Fatal Error: APT_BufferOperator::writeAllData() write failed. This is probably due to a downstream operator failure. i have trie...

DBA should be able to help you.

from tuning perspective ths might help you

Creating indexes on the table you are trying to load
Partitioning the table
increasing the intial table size

Thanks
Srividya

Was the testing in dev and pre-prod done with near real time data ??? That is the main reason my jobs fail in prod even though they are successful in testing phase. Sad, we cannot get near PROD data ..so we are prepared for these fixes ...any thing can differ ..end delimeter .. length of column, dat...

you can also try the date conversion if loading into a Database

Sorting the data and then introducing the hash partition would be a good option ... or remove duplicates based on your key values and then use it for Upsert ... either of them should help you fix the issue. One reason i got dead lock was .. the table was accessed continuously ( through Datastage onl...

Yes ... using the database sequences definitely slowed our jobs significantly... The more data we tried processing, the worse the performance got ... We have to go for a re-design :? .... This is what we are doing(trying to :oops:) ......We have created a UNIX script which returns the maximum of the...

Hi all ... Thanks for the response The error we get is "Failed to connect to Host", the same one we get when a wrong password or server name is given. They are right and the same can be used to connect from Onsite We connect to the environment using a citrix connection. The client is insta...

Hi We have got a strange issue on one of our DataStage environments We have got a team at offshore which can not access DataStage from their boxes. They can access the UNIX box on which the DataStage is installed, the DataBase ...everything on that box except for DataStage. I am working in a differe...

fixed it ... we HAD to read the data in sequence .... as the production env is on 2 nodes the data was getting split and ..... so i changed the partitioning stratergy at the tranformer input and it works fine now

Thanks all ...
Sri

Hi Guys ..Thanks ..seeing your answers keeps my hopes alive I am using a transformer with lots of Stage variables and nearly 15 constraints :D I tried running the job with peek stage after removing the DB stages ... its still the same .... All the parameters are proper any more suggestions...ready t...

Nothing .. it is a clean run ... the job design is like this I read data from a sequential filke .. load it into ten tables based on the first two attributes if it is 01 then Table 1, 02 then Table 2 ..etc The data is getting re-mapped and flowing to wrong tables in Production..when we ran the same ...