DSXchange

When you say sorted, are you meaning Datastage sorted? I have ordered by the fields I need when I extract from db2 and, yes, it is hash partitioned.

I have a problem with a join stage. It has three inputs coming from several db2 stages. The main link recovers about 10 million records, one of the update link recovers over 3 millions and the other update about 150.000 records. After the join operation I make an aggregation and then I write records...

Thanks for your response. I have to use a join stage in anyway, but if so, the server crashes with an error like an overflow. I supose that it is because of the high volume of data I process. Is there any environment variable to force to use more hard disk within join stage?

Greetings,

I have an issue with the merge stage. I have one main stream from a db2 source and 2 update streams from two different db2 source too. When I try to merge them, I find that there are about a 15% data that hasn't been updated but it should have done. I have "auto" partition set to the main ...

I think you should use DB2 stage

You can run a cmd script from windows that launchs the ftp utility and connect to your unix server and get the file without install anything

Due to database load restrictions, I have to load a file of 2Million records in chunks of 5000 records at a time. For my approach I have been using a Sequence loop but the performance is not good. It seems it got to be a better way. Here is my approach: Using a Sequence Loop, I pick 5000 records vi...

[quote="cosec"]What if there are lots of records in the target table....will it affect performance ? Wouldn't it better to have a separate job to clear the table like ray says....or before routine script ?? Anyone know of a script to clear the tables ? [quote="reypotxo"][quote=&q...

[quote="cosec"]I am using a DB2 stage. Should I use like a DELETE or is there anything else to clear multiple tables ?[/quote] I recommend you to write all your delete sentences in the first DB2 stage's before label which has the DB2 component; using the operator ';' (without quotes) as se...

[quote="abhilashnair"]We have a server job which runs daily. Normally it takes approx 7 minutes to complete. But the yesterdays run of this job is still in running state. No warnings whatsoever. We are not accessing any Databases. Only seq files and hash files. All the files required are i...

Thanks, thanks...NOW IT'S WORKING!!!!!!

Hi again, although the params data, stack etc, are now set to unlimited and the sort is performed in the Agg, but we're having the same problem...

Hi, thanks, its my first time here

Now we're changing the stack, data and another params...Hope to fix the problem...

I've change also the Partition Type to Modulus because Sort is not avalaible in the Agg...


Thank you very much!!!!

Hi, we are having problems while processing a Sequential file (more than 2 millions of rows, and approx 10 columns, 5 to group by and 5 to sum them). The message logged in the DS Director is: Fatal Error: Throwing exception: APT_BadAlloc: Heap allocation failed Could anyone help me? Thanks in advanc...